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Defendant-Counterclaimant Public.Resource.Org, Inc. hereby submits the following 
objections to the Declarations submitted in support of Plaintiffs’ Motion for Summary Judgment 
and for Permanent Injunction, ECF No. 60. 

STANDARDS FOR ADMISSIBLE EVIDENCE IN 
RULING ON A MOTION FOR SUMMARY JUDGMENT 

It is fundamental that trial courts “can only consider admissible evidence in ruling on a 
motion for summary judgment.” Orr v. Bank of America, 285 F.3d 764, 773 (9th Cir. 2002) 
(emphasis added); see also Fed. R. Civ. P. 56(c); Fed. R. Fvid. 101 (Rules of Evidence apply to 
all proceedings in the courts of the United States); Fed. R. Fvid. 1101 (listing exceptions to 
Rule 101). Hearsay, documents that cannot be authenticated, out-of-context excerpts, and 
evidence with no foundation will not suffice, and are not to be considered by the court in ruling 
on motions for summary judgment or adjudication. See Block v. City of Los Angeles, 253 F.3d 
410, 418-19 (9th Cir. 2001) (deciding that consideration of a declaration’s facts not based on 
personal knowledge was an abuse of discretion because such facts were inadmissible). Much of 
the evidence on which Plaintiffs attempt to rely fails to meet the minimum threshold 
requirements of admissibility, as set forth below: 

A, Irrelevant Evidence 

Irrelevant evidence cannot be considered in summary judgment proceedings. See Fed. R. 
Fvid. 402; see also U.S. ex rel. Miller v. Bill Harbert Intern. Const., Inc., 608 F.3d 871, 897 
(D.C. Cir. 2010) (“To be admitted, evidence must be relevant.”); Smith v. Hughes Aircraft Co., 
22 F.3d 1432, 1439 (9th Cir. 1993) (affirming trial court’s refusal to consider irrelevant evidence 
on summary judgment); Uche-Uwakwe v. Shinseki, 972 F. Supp. 2d 1159, 1165 (C.D. Cal. 2013) 
(sustaining objection that statement filed in support of motion for summary judgment was 
inadmissible for lack of relevance and foundation). 
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B. Lack of Personal Knowledge/Foundation 

A fact witness may not testify to a matter unless the witness has personal knowledge of 
the matter. Fed. R. Evid. 602; Fed. R. Civ. P. 56(c) (“declaration used to support or oppose a 
motion must be made on personal knowledge, set out facts that would be admissible in evidence, 
and show that the affiant or declarant is competent to testify on the matters stated”); U.S. v. 
Davis, 596 F.3d 852, 856 (D.C. Cir. 2010) (“The Rules also prohibit a witness from testifying 
unless he has personal knowledge of the subject of his testimony.”); Orr, 285 F.3d at 774 & n.9; 
Express, LLC v. Fetish Group, Inc., 464 F. Supp. 2d 965, 973 (C.D. Cal. 2006) (“Declarations 
submitted in conjunction with summary judgment proceedings must ... be based on personal 
knowledge”). Further, “[a] declarant’s mere assertions that he or she possesses personal 
knowledge and competency to testify are not sufficient.” Boyd v. City of Oakland, 458 F. Supp. 
2d 1015, 1023 (N.D. Cal. 2006). A declarant must show personal knowledge and competency 
“affirmatively,” under Rule 56, for example, by “the nature of the declarant’s position and nature 
of participation in matter.” Id.; see also Barthelemy v. Air Lines Pilots Ass’n, 897 F.2d 999, 1018 
(9th Cir. 1990) (inferring personal knowledge from affiants’ “positions and the nature of their 
participation in the matters to which they swore”). The fact that Public Resource does not object 
to the witnesses’ testimony that they have personal knowledge of the facts stated in their 
declarations and are competent to testify thereto does not in any way signal Public Resource’s 
agreement with those assertions. Public Resource merely does not contend those statements are 
inadmissible — but they may be wrong. 

C. Improper Lay Testimony on Legal Conclusions or Expert Subject Matter 

Legal conclusions are not admissible evidence. See Pierce v. Kaiser Found. Hospitals, 
CV 09-03837 WHA, 2010 WL 4590930, at *8 (N.D. Cal. Nov. 4, 2010), aff’d, 470 F. App’x 649 
(9th Cir. 2012) (excluding numerous declarant statements containing inadmissible legal 
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conclusions). The Declarants, without any legal expertise, repeatedly purport to state legal 
conclusions and the legal effects of documents supposedly relevant to this dispute. See Fed. R. 
Evid. 701; see also Evangelista v. Inlandboatmen’s Union ofPac., Ill F.2d 1390, 1398 n.3 (9th 
Cir. 1985) (lay opinion construing contract provisions is inadmissible); Pierce, 2010 WL 
4590930, at *8 (declaration that opponent “breached” agreement or “violated” laws is 
inadmissible legal conclusion). 

Testimony requiring scientific, technical, or other specialized knowledge may be given 
only by an expert witness with the requisite knowledge, skill, experience, training, or education, 
and opinion testimony is not permitted of a lay person. Fed. R. Evid. 701, 702; see also United 
States V. Hampton, 718 F.3d 978, 981-82 (D.C. Cir. 2013) (finding error when district court 
allowed FBI agent to testify as a lay witness in the form of an opinion without an applicable 
exception in Rule 701); US. Aviation Underwriters, Inc. v. Yellow Freight Sys., Inc., 296 F. 
Supp. 2d 1322, 1331 (S.D. Ala. 2003) (unqualified expert opinions inadmissible at summary 
judgment). The “proponent of the expert bears the burden of demonstrating that the expert is 
qualified.” Gable v. Nat’l Broad. Co., 727 F. Supp. 2d 815, 833 (C.D. Cal. 2010), affd, 438 F. 
App’x 587 (9th Cir. 2011) (citing United States v. 87.98 Acres of Land More or Less in the 
County of Merced, 530 F.3d 899, 904-05 (9th Cir. 2008)). See also Kumho Tire Co. v. 
Carmichael, 526 U.S. 137, 147-48 (1999) (expert must have specialized knowledge). 

One type of improper lay opinion is unsupported, speculative, and conclusory statements. 
These statements, as well as and claims of opposing parties and their attorneys, are not evidence 
and do not raise a genuine issue of material fact sufficient to preclude summary judgment. 

Lujan V. Nat’l Wildlife Fed’n, 497 U.S. 871, 888 (1990) (The purpose of Rule 56(e) is “not to 
replace conclusory allegations of the complaint with conclusory allegations of an affidavit.”). 
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Rather, “[wjhere the moving party will have the burden of proof at trial, it must affirmatively 
demonstrate that no reasonable trier of fact could find other than for the moving party.” Int’l 
Church of Foursquare Gospel v. City of San Leandro, 902 F. Supp. 2d 1286, 1290-91 (N.D. Cal. 
2012) (citing Soremekun v. Thrifty Payless, Inc., 509 F.3d 978, 984 (9th Cir. 2007)). Cf Orr, 

285 F.3d at 783 (“To defeat summary judgment, [one opposing summary judgment] must 
respond with more than mere hearsay and legal conclusions”); Cambridge Flees. Corp. v. MCA 
Flees., Inc., 227 F.R.D. 313, 320 (C.D. Cal. 2004) (“Conclusory, speculative testimony in 
affidavits and moving papers is insufficient to raise genuine issues of fact and defeat summary 
judgment”). 

D. Hearsay 

Generally, “inadmissible hearsay evidence may not be considered on a motion for 
summary judgment.” Anheuser-Busch, Inc. v. Natural Beverage Distribs., 69 F.3d 337, 345 n.4 
(9th Cir. 1995); see also Blair Foods, Inc. v. Ranchers Cotton Oil, 610 F.2d 665, 667 (9th Cir. 
1980) (“hearsay evidence is inadmissible and may not be considered by this court on review of a 
summary judgment”); Riggsbee v. Diversity Servs., Inc., 637 F.Supp.2d 39, 46 (D.D.C. 2009) 
(“on summary judgment, statements that are impermissible hearsay or that are not based on 
personal knowledge are precluded from consideration by the Court.”); In re Cypress 
Semiconductor, Inc. Sec. Litig., 891 F. Supp. 1369, 1374 (N.D. Cal. 1995) (hearsay evidence 
cannot be considered in summary judgment proceedings), aff’d, 113 F.3d 1240 (9th Cir. 1997). 

E. Unauthenticated Documents 

Authentication or identification is a condition precedent to the admissibility of a 
document. Fed. R. Evid. 901. Under Federal Rule of Civil Procedure 56, evidence in support of 
a motion for summary judgment is objectionable if it cannot be presented in a form that would be 
admissible. A document cannot be authenticated by one who does not have personal knowledge 
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of its authenticity. The foundation is laid for receiving a docimient m evidence by the testunony 
of a witness with personal knowledge of the facts who attests to the identity and due execution of 
the docimient and, where appropriate, its delivery. United States v. Dibble, 429 F.2d 598, 602 
(9th Ch. 1970). If there Plaintiffs are imable to show that they could authenticate a document at 
trial, then the document should not be considered in support of Plamtiffs’ motion for smmuaiy 
judgment. 

F. Secondary Evidence Rule 

The “secondary evidence rule” requhes that contents of documents must be proved by 
producing the docmuent itself. Fed. R. Evid. 1001, 1002. 

OBJECTIONS TO DECLARATIONS FILED IN SUPPORT OF 
PLAINTIFFS’ MOTION FOR SUMMARY JUDGMENT 

II. OBJECTIONS TO THE DECLARATION OF WAYNE J. CAMARA IN 

SUPPORT OF PLAINTIFFS’ MOTION FOR SUMMARY JUDGMENT AND 
ENTRY OF A PERMANENT INJUNCTION 


Declaration of Wayne J. Camara In Support 
of Plaintiffs’ Motion for Summary Judgment 

Defendant-Counterclaimant 

Public Resource’s Objections 

1. 1 am the Senior Vice President, Research at 
ACT. My company produces and publishes the 
ACT® college readiness assessment — a 
college admissions and placement test taken 
{sic by] millions of high school graduates every 
year'. ACT also offers comprehensive 
assessment, research, information, and program 
management services to supporf education and 
workforce development. As the Senior Vice 
President of Research, I am responsible for all 
research and evidence related to the design, 
development, irse, and validation of oin 
assessments and programs. In my position, I 
serve on the Senior Leadership Team and 
manage over 110 researchers. 

No Objection. 
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Declaration of Wayne J. Camara In Support 
of Plaintiffs’ Motion for Summary Judgment 

Defendant-Counterclaimant 

Public Resource’s Objections 

2. 1 submit this Declaration in support of the 
motion of the American Educational Research 
Association, Inc. (“AERA”), the American 
Psychological Association, hic. (“APA”), and 
the National Coimcil on Measmement in 
Education, Inc. (“NCME”) (collectively, 
“Plaintiffs” or “Sponsoiing Organizations”) for 
sunuuaiy judgment and the entry of a 
permanent injimction. 

No Objection. 

3. Prior to working at ACT, I worked at 

The College Board, where I held the positions 
of Vice President, Research and Development 
(July, 2000 - September, 2013), Execrrtive 
Director, Office of Research and Development 
(March, 1997 — Jrme, 2000), and Research 
Scientist (September, 1994 — Febnrary, 1997). 

No Objection. 

4. Before working at The College Board, I 
worked for APA in the positions of Assistant 
Execrrtive Duector for Scierrtific Affairs and 
Execrrtive Duector of Science (1992-1994), 
Director, Scientific Affairs (Febnrary, 1989 — 
Arrgrrst, 1992), and Testing and Assessment 
Officer (November, 1987 - Janrrary, 1989). 
Druing my time at APA, I also served as the 
Project Duector for the revision of the 1985 
edition of the Standards for Educational and 
Psychological prtblished in 1999 (the 

“1999 Standards”). In 1997, 1 was elected to 
APA’s Cormcil of Representatives, and I served 
on the Cormcil from 1997-2003. In April. 2012, 

I was elected to the AERA Cormcil, serving 
from April, 2012 to April, 2015 as Vice 

President for Division D. I was also elected to 
NCME’s Board of Duectors, servmg on the 
Board from 2002-2005 and 2009-2012, and 
served as NCME’s President from 2010-2011. 
Additionally, I have served orr the Management 
Committee for the Standards from 2005-2015. 

No Objection. 

5. My cruiicrrhrm vitae is attached to this 
Declaration as Exhibit 1 . 

No Objection. 
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Declaration of Wayne J. Camara In Support 
of Plaintiffs’ Motion for Summary Judgment 

Defendant-Counterclaimant 

Public Resource’s Objections 

6. 1 have wiitten extensively on the Standards, 
as well as other professional and technical 
guidelines which relate to educational and 
indushial testing and assessment, including 
joiuTial articles, book chapters, and paper 
presentations at national conferences. 

No Objection. 

7. In 1954, APA prepared and published the 
“Technical Recommendations for Psychological 
Tests and Diagnostic Tecluiiques.” In 1955, 
AERA and NCME prepared and published a 
companion document entitled, “Technical 
Recommendations for Achievement Tests.” 
Subsequently, a jomt committee of the tliree 
organizations modified, revised, and 
consolidated the two dociunents into the first 
Joint Standards. Beginning with the 1966 
revision, the Sponsoring Organizations 
collaborated in developing the “Joint 

Standards” (or simply, the “Standards”). Each 
subsequent revision of the Standards has been 
carefiil to note that it is a revision and update of 
the prior version. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal krrowledge of the matter 
and the proffering party has not irrtrodirced 
sirfficient evidence to show the witness has 
personal knowledge of this matter, particirlarly 
for arry time period prior to his employment 
with one of the Plaintiffs. 

8. Beginning in the mid-1950s, the Sponsoring 
Organizations fonned and periodically 
reconstihited a committee of highly trained and 
experienced experts in psychological and 
educational assessment, charged with the initial 
development of the Technical Recommen- 
dations and then each subsequent revision of the 
(renamed) Standards. These committees were 
fonned by the Sponsoring Organizations’ 
Presidents (or then designees), who would meet 
and jointly agr ee on the membership. Often a 
chan or co-chahs of these committees were 
selected by joint agreement. Begiiming with the 
1966 version of the Standar ds, this committee 
became referred to as the “Joint Committee.” 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introdirced 
sufficient eviderrce to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opinion. The proffered 
testimony contains lay opinion that is not 
rationally based on the witness’s perception 
and is not helpfirl to clearly imderstanding the 
witness’s testimony or to detenniuing a fact in 
issue, including becairse the proffered 
testimony is conchrsory. 

9. Financial and operational oversight for the 
Standards’ revisions, promotion, distribution, 
and for the sale of the 1999 and 2014 Standards 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony concerning what occimed 
before 2005 is not based on the witness’s 
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Declaration of Wayne J. Camara In Support 
of Plaintiffs’ Motion for Summary Judgment 

Defendant-Counterclaimant 

Public Resource’s Objections 

has been imdeitakeu by a periodically 
reconstibited Management Committee, 
comprised of designees of the thr ee Sponsoring 
Organizations. As noted above, I served on this 
Management Committee from 2005-2015. 

personal knowledge of the matter and the 
proffering party has not introdrrced srrffrcient 
evidence to show the witness has personal 
knowledge of this matter. 

10. All members of the Joint Cormnittee(s) and 
the Management Committee(s) are wtpaid 
vobmteers. The expenses associated with the 
ongoing development and publication of the 
Standards mclude travel and lodging expenses 
(for the Joint Committee and Management 
Coirmiittee members), support staff time, 
printing and shipment of boimd vohrrnes, and 
advertising costs. 

FRE 403 Prejitdice. The testimony omits any 
relevant timeframe, which confrrses the issires, 
and it fails to acknowledge or discrrss the 
expenses that a large niuuber of rmpaid 
vobmteers and their employers bore in the 
drafting of the Standar ds. 

FRE 602 Lack of Personal Krrowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introdrrced 
srrffrcient evidence to show the witness has 
personal knowledge of this matter. 

1 1 . From the time of their initial creation to the 
present, the preparation of and periodic 
revisions to the Standards entail intensive labor 
and considerable cross-disciplinary expertise. 
Each time the Standards are revised, the 
Sponsoring Organizations select and arrange for 
meetings of the leading arrthorities in 
psychological and edrrcational assessments 
(known as the Joint Committee). Druing these 
meetings, certain Standards are combined, 
pared down, and/or airgmented, others are 
deleted altogether, and some are created as 
whole new individiral Standards. The 1999 
version of the Standards is nearly 200 pages, 
took more than frve years to complete, and is 
the result of work prrt in by the Joint Committee 
to generate a set of best practices on edrrcational 
and psychological testing that are respected and 
relied irpon by leaders in theu frelds. 

FRE 403 Prejitdice. The testimony omits any 
relevant timeframe, which confrrses the issues. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introdrrced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfirl to clearly imderstanding the witness’s 
testimony or to determining a fact in issue, 
mchrdrug because the proffered testimony is 
conchrsory; and is based on scientific, 
technical, or other specialized knowledge 
within the scope of Rule 702. 

FRE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of a 
docirment. 
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Declaration of Wayne J. Camara In Support 
of Plaintiffs’ Motion for Summary Judgment 

Defendant-Counterclaimant 

Public Resource’s Objections 

12. Draft revisions of the 1985 Standards, for 
what became the 1999 Standards, were widely 
dishibuted for public review and counneut 
dining the revision process. The Joint 

Committee received thousands of pages of 
comments and proposed text revisions fiom: the 
membership of the Sponsoring Organizations, 
scientific, professional, trade and advocacy 
groups, credeutialing boards, state and federal 
goveiimient agencies, test publishers and 
developers, and academic institutions. While 
the Joint Coimnittee reviewed and took imder 
advisement these helpftil comments, the final 
language of the 1999 Standards was a product 
of the Joint Coimnittee members. Wlieu the 

1985 Standards were revised, more than half the 
content of the 1999 Standards resulted fiom 
newly wr itten prose of the Joint Committee. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
wihress’s personal knowledge of the matter 
and the proffering party has not intr oduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. For 
example, the witness does not claim to have 
reviewed each sirbmission personally, or to 
have supervised each member of the Joint 
Committee’s review of the couunents. Nor 
does the witness claim to have personal 
knowledge of whether prose written by other 
members of the Joint Committee was “newly 
written.” 

FRE 701 Improper Lay Opuiion. The proffered 
testimony contains lay opinion that is not 
rationally based on the witness’s perception 
and is not helpfirl to clearly imderstanding the 
witness’s testimony or to determining a fact in 
issire, inchrding becairse the proffered 
testimony is conclusory. 

FRE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of 
numerous documents. 

13. The Standards originally were created as 
principles and guidelines - a set of best 
practices to improve professional practice in 
testing and assessment across multiple settings, 
including education and various areas of 
psychology. The Standards can and should be 
used as a recommended course of action in the 
soimd and ethical development and use of tests, 
and also to evaluate the quality of tests and 
testing practices. Additionally, an essential 
component of responsible professional practice 
is maintaining technical competence. Many 
professional associations also have developed 
standards and principles of technical practice in 
assessment. The Sponsoring Organizations’ 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering parly has not mtrodirced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opmion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfirl to clearly imderstanding the witness’s 
testimony or to determining a fact in issue, 
including because the proffered testimony is 
conclusory; and is based on scientific, 
technical, or other specialized knowledge 
within the scope of Rule 702. 
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Standards have been and still are used for this 
piupose. 


14. The Standards, however, are not simply 
intended for members of the Sponsoring 
Organizations, AERA, APA, and NCME. The 
intended audience of the Standards is broad and 
cuts across audiences with varying backgioimds 
and different training. For example, the 

Standards also are intended to guide test 
developers, sponsors, publishers, and users by 
providing criteria for the evaluation of tests, 
testing practices, and the effects of test use. Test 
user standards refer to those standards that help 
test users decide how to choose ceitain tests, 
iuteipret scores, or make decisions based on 
tests results. Test users include cluiical or 
industrial psychologists, research dir ectors, 
school psychologists, coimselors, employment 
supervisors, teachers, and varioirs 
administrators who select or interpret tests for 
their organizations. There is no mechanism, 
however, to enforce compliance with the 
Standards on the part of the test developer or 
test irser. The Standards, moreover, do not 
attempt to provide psychometric answers to 
policy or legal qirestions. 

ERE 403 Prejitdice. The testimony omits any 
relevant timeframe, which confirses the issires. 

ERE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introdirced 
srrffrcient evidence to show the witness has 
personal knowledge of this matter. 

ERE 701 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
based orr the witness’s perception; is not 
helpfirl to clearly imderstanding the witness’s 
testimony or to determining a fact in issue, 
inchrdmg becairse the proffered testimony is 
conchrsory and contains legal couchrsions; and 
is based on scientific, teclmical, or other 
specialized knowledge within the scope of 

Rule 702. 

ERE 702 Umeliable Expert Opinion. The 
proffered testimony on the goals, intent, and 
operation of the Standards is an expert opinion 
by a witness who is not qiralifred as an expert 
by knowledge, skill, experience, training, or 
edrrcation. The testimony fruther will not help 
the trier of fact to imderstand the evidence or 
to determine a fact in issue; is not based on 
sufficient facts or data; is not the prodirct of 
reliable principles and methods; and is not 
based on the expert’s reliable application of 
reliable principles and methods to the facts of 
the case. 

ERE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of a 
docirment. 

15. The Standards promote the development of 
high qirality tests and the soiuid itse of resrrlts 
from sirch tests. Withoirt srrch high qrrality 

ERE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
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standards, tests might produce scores that are 
not defensible or accmate, not an adequate 
reflection of the characteristic they were 
intended to measiue, and not fan to the person 
tested. Consequently, decisions about 
individuals made with such test scores would be 
no better, or even worse, than those made with 
no test score infoimation at all. Thus, the 
Standards help to ensine that measiues of 
student achievement are relevant, that 
admissions decisions are fair, that employment 
hir ing and professional credentialing result in 
qualified individuals being selected, and 
patients with psychological needs are diagnosed 
properly and treated accordingly. Quality tests 
protect the public fiom hanuful decision 
making and provide oppoilunities for education 
and emplojTuent that are fan to all who seek 
them. 

and the proffering party has not introdrrced 
srrfficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfirl to clearly imderstanding the witness’s 
testimony or to determining a fact in issire, 
mchrdmg becartse the proffered testimony is 
conclusory; or is based on scientific, technical, 
or other specialized knowledge within the 
scope of Ritle 702. 

16. The Standards apply broadly to a wide 
range of standardized instimuents and 
procedines that sample an individuaTs 
behavior, including tests, assessments, 
inventories, scales, and other testing vehicles. 

The Standards apply equally to standardized 
multiple-choice tests, performance assessments 
(inchrding tests comprised of only open-errded 
essays), and hands-on assessments or 
simirlations. The main exceptions are that the 
Standards do not apply to rmstandardized 
qrrestiormahes (e.g . , imstnrctined behavioral 
checklists or observational forms), teacher- 
made tests, and srrbjective decision processes 
(e.g., a teacher’s evahration of stirdents’ 
classroom participation over the coiuse of a 
semester). 

FRE 402 Relevance. Tire proffered testimony 
concerning the types of testing the standards 
apply to does not have any tendency to make a 
fact of conseqirence in this litigation more or 
less probable than it woirld be withoirt the 
evidence. 

FRE 403 Prejirdice. The testimony omits any 
relevant timeframe and does not specify which 
editions of the Standards are refened to, which 
conflrses the issrres. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introdrrced 
srrfficient eviderrce to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfirl to clearly imderstanding the witness’s 
testimony or to determining a fact in issue. 
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including because the proffered testimony is 
conclusory; and is based on scientific, 
technical, or other specialized knowledge 
within the scope of Rule 702. 

FRE 702 Umeliable Expert Opinion. The 
proffered testimony on the application of the 
Standards is an expert opinion by a witness 
who is not qiralifred as an expert by 
knowledge, skill, experience, training, or 
edircation. The testimony fiuther will not help 
the trier of fact to imderstand the evidence or 
to determine a fact in issire; is not based on 
sirfficient facts or data; is not the prodirct of 
reliable principles and methods; and is not 
based on the expert’s reliable application of 
reliable principles and methods to the facts of 
the case. 

17. The Standards have been used as a soiuce in 
developing testing guidelines for such activities 
as college admissions, personnel selection, test 
translations, test user qualifications, and 
computer-based testing. The Standards also 
have been widely cited to addiess technical, 
professional, and operational noiins for all 
foiins of assessments that are professionally 
developed and used in a variety of settings. The 
Standards additionally provide a valuable public 
seiwice to state and federal governments as they 
volimtaiily choose to use them. For instance, 
each testing company, when submitting 
proposals for testing administration, instead of 
relying on a patchwork of local, or even 
individual and proprietary, testing design and 
implementation criteria, may rely instead on the 
Sponsoiing Organizations’ Standards to afford 
the best guidance for testing and assessment 
practices. 

FRE 402 Relevance. Hie proffered testimony 
concerning the use of the Standards does not 
have any tendency to make a fact of 
conseqirence in this litigation more or less 
probable than it woirld be withoirt the 
evidence. 

FRE 403 Prejudice. The testimony omits any 
relevant timefiame, which conftrses the issues. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering parly has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfiil to clearly rmderstanding the witness’s 
testimony or to determuiing a fact in issue, 
including because the proffered testimony is 
conclusory; and is based on scientific, 
technical, or other specialized knowledge 
within the scope of Rule 702. 
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FRE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of 
documents. 

18. The Standards were not created or updated 
to serve as a legally binding document, in 
response to an expressed goveiimiental or 
regulatoiy need, nor in response to any 
legislative action or judicial decision. However, 
the Standards have been cited injudicial 
decisions related to the proper use and evidence 
for assessment, as well as by state and federal 
legislators. These citations injudicial decisions 
and dining legislative deliberations occimed 
without any lobbying by the Plaintiffs. 

FRE 403 Prejudice. The testimony omits any 
relevant timeframe, which confrises the issues 
as to which editions of the Standards and 
which years the witness is refening to. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter, particularly 
as to the goals of the many authors of the 
Standards. 

FRE 701 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception and is not 
helpfril to clearly imderstanding the witness’s 
testimony or to detennining a fact in issue, 
including because the proffered testimony is 
conchisory. 

FRE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of a 
document. 

19. The Sponsoring Organizations do not keep 
any of the revenues generated from the sales of 
the Standards. Rather, the income from these 
sales is used by the Sponsoiing Organizations 
to offset their development and production costs 
and to generate frmds for subsequent revisions. 
This allows the Sponsoiing Organizations to 
develop up-to-date, high quality Standards that 
otherwise would not be developed due to the 
time and effort that goes into producing them. 

FRE 403 Prejudice. The statement that the 
Plaintiffs do not “keep” any of the revenues, 
but use them for ceilain operating expenses, is 
incomplete and misleading, because Plaintiffs 
do keep the revenues but simply earmark them 
for particular pmposes. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
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based on the witness’s perception, including 
becairse it is specirlative; is not helpfirl to 
clearly imderstanding the witness’s testimony 
or to determirrurg a fact in issire, inclirdiug 
becairse the proffered testimony is conclusory; 
or is based on scientific, teclmical, or other 
specialized knowledge within the scope of 

Rule 702. 

FRE 702 Umeliable Expert Opinion. The 
proffered testimony is an expert opinion by a 
witness who is not qualified as an expert by 
knowledge, skill, experience, training, or 
education. The testimony fruther will not help 
the trier of fact to imderstand the evidence or 
to determuie a fact m issue; is not based on 
sufficient facts or data; is not the product of 
reliable principles and methods; and is not 
based on the expert’s reliable application of 
reliable prmciples and methods to the facts of 
the case. 

20. At one time, flmding for the Standards 
revision process from third party somces (e.g., 
governmental agencies, formdations, other 
associations interested in testing and assessment 
issues, etc.) was raised as a consideration. 
However, this option was not seriously explored 
as the potential conflicts of interest m doing so 
left the Sponsoring Organizations to conchrde 
that the Standards revisions should be self- 
ftmding - that is, fr om the sale of prior editions 
of the Standards. 

FRE 403 Prejudice. The testimony omits any 
relevant tunefiame, which confirses the issues 
as to which editions of the Standards and 
which years the witness is referring to. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering parly has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opuiion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfirl to clearly imderstanding the witness’s 
testimony or to determining a fact in issue, 
including because the proffered testimony is 
conclusory; and is based on scientific, 
teclmical, or other specialized knowledge 
within the scope of Rule 702. 

FRE 802 Hearsay. The proffered testimony 
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relies on an out-of-coiu1 statement that is 
offered to prove the truth of the matter 
asserted. 

21. In late 2013 and early 2014, the Sponsoring 
Organizations became aware that the 1999 
Standards had been posted on the Internet 
withoirt then airthorization, and that psychology 
stirdents were obtaining free copies from the 
posting soiuce. Upon fruflrer investigation, the 
Sponsoritrg Organizations discovered that 
Pitblic.Resomce.Org, Inc. (“Pirblic Resource”) 
was the soiuce of the online posting. 
Accompanying this Declaration as 

Exhibit MMM is a tnre copy of a thr ead of 
emails exchanged among Laiuie Wise, Suzarme 
Lane, David Frisbie, Jeriy Sroirfe, Mariarme 
Ernesto, Barbara Plake, and myself^ sent 
between December 16, 2013 and Febnrary 4, 
2014, discussing Public Resoiuce’s posting of 
the 1999 Standards on the Internet, and marked 
as Exhibit 1185 diuirrg my deposition.’ 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 70 1 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfirl to clearly imderstanding the witness’s 
testimony or to determuiing a fact in issue, 
including because the proffered testimony is 
conclusory. 

FRE 802 Hearsay. The proffered exhibit is an 
out-of-coiuf statement that is offered to prove 
the truth of the matter asserted. 

22. Past harm to the Sponsoring Organizations 
from Pirblic Resoiuce’s activities includes a 
lack of gr eater frmding that otherwise would 
have been available for the update of the 
Sponsoring Organizations’ Standards from the 
1999 to the 2014 versions, due to the reduced 
volume of sales of the 1999 Standards. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 70 1 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfirl to clearly imderstanding the witness’s 
testimony or to determining a fact in issue, 
including because the proffered testimony is 


* Laiuie Wise is the Immediate Past Piesident of NCME and was seiwing as President of NCME 
at the time of the email, Suzaime Lane is a member of the Standar ds Management Committee: 
David Frisbie also is a member of the Standar ds Management Comnrittee; Jeny Sroirfe is the 
Director of Govermnent Relations at AERA, Mariarme Ernesto is the Director, Testing and 
Assessment, at APA, arrd Barbara Plake was Lamie Wise’s co-chah of the Joint Comnrittee for 
the revision of the 1999 Standards, which irltimately were pitblished in 2014. 
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conclusory. 

23. Should Public Resomce’s infringement be 
allowed to continue, the haiiu to the Sponsoring 
Organizations, and public at large who rely on 
the preparation and administration of valid, fan 
and reliable tests, includes: (i) imcontiolled 
publication of the 1999 Standards without any 
notice that those guidelines have been replaced 
by the 2014 Standards; (ii) fritine imquantifiable 
loss of revenue fr om sales of authorized copies 
of the 1999 Standards (with proper notice that 
they are no longer the ciuient version) and the 
2014 Standards; and (iii) lack of frmding for 
fritm e revisions of the 2014 Standards and 
beyond. 

FRE 403 Prejudice. The 2014 Standards are 
not at issue in this litigation, and Plaintiffs 
vohmtaiily stopped selling the 1999 Standards, 
the only edition at issue. The witness’s 
statement is misleading because it suggests 
that Public Resoiuce’s actions risk depriving 
Plaintiffs of income fr om the sale of the 2014 
Standards. The witness’s statement is also 
speculative and risks confrising the issues in 
this case. 

FRE 602 Lack of Personal Knowledge. The 
proffered testunony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opuiion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfixl to clearly imderstanding the witness’s 
testimony or to detenninmg a fact in issue, 
including because the proffered testimony is 
conclusory; and is based on scientific, 
technical, or other specialized knowledge 
within the scope of Rule 702. 

FRE 702 Umeliable Expert Opinion. The 
proffered testimony concerning harm 
attributed to Pirblic Resomce is an expert 
opurion by a witness who is not qiralified as an 
expert by knowledge, skill, experience, 
trainurg, or education. The testimony fiuther 
will not help the trier of fact to imderstand the 
evidence or to determine a fact in issire; is not 
based on sufficieirt facts or data; is not the 
product of reliable principles and methods; and 
is not based on the expert’s reliable application 
of reliable principles and methods to the facts 
of the case. 
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24. Due to the small membership size of 

NCME, and the relative minor portion of the 
membership of AERA and APA who devote 
then careers to testing and assessment, it is 
highly imlikely that the members of the 
Sponsoring Organizations will vote for a dues 
increase to flmd fiitine Standards revision 
efforts if Public Resoince successMly defends 
this case and is allowed to post the Standards 
online for the public to download or print for 
free. As a result, the Sponsoring Organizations 
would likely abandon then practice of 
periodically updating the Standards and there 
would be an absence of any authoritative and 
independent soince of soimd guidance relating 
to the development, use, and evaluation of 
psychological and educational tests. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not intr oduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opmion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfiil to clearly imderstanding the witness’s 
testimony or to detennining a fact in issue, 
including because the proffered testimony is 
conclusory; or is based on scientific, technical, 
or other specialized knowledge within the 
scope of Rule 702. 


III. OBJECTIONS TO THE DECLARATION OF MARIANNE ERNESTO IN 

SUPPORT OF PLAINTIFFS’ MOTION FOR SUMMARY JUDGMENT AND 
ENTRY OF A PERMANENT INJUNCTION 


Declaration of Marianne Ernesto In Support 
of Plaintiffs’ Motion for Summary Judgment 

Defendant-Counterclaimant 
Public.Resource.Org, Inc.’s Objections 

1. 1 am the Director, Testing and Assessment, at 
the American Psychological Association, Inc. 
(“APA”). I have been employed with the APA 
since May 2001. 1 srrbmit this Declaration in 
srrpport of the motion of the American 
Edrrcatiorral Research Association, Inc. 
(“AERA”), the APA, and the National Cormcil 
on Measruement in Edrrcation, Inc. (“NCME”) 
(collectively, “Plaintiffs” or the “Sponsoring 
Organizations”) for a srnnmary jirdgment and 
the entry of a perinarrent injimction. 

No Objection . 

2. In my role as Director, Testing and 
Assessment, I serve as APA’s primary airthority 
on all matters that relate to testing and 
assessment. This srrbject matter mchrdes 

No Objection. 
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educational testing, clinical assessment, 
forensic testing and employment testing. I 
advocate on behalf of APA in matters involving 
federal or state legislative, regulatory or other 
pohcy issues conceming testing and 
assessment. I coordinate APA’s involvement in 
testing issues in matters such as governance, 
executive boards, and managerial bodies. I also 
manage APA’s responses to internal, public, 
member and media inqiiuies regarding testing 
issues in a maimer that is consistent with the 
Standards for Educational and Psychological 
Testing (the “Standards”). I advise, coimsel and 
oversee the activities of the APA’s Science 
Duectorate (and m particular its Office of 

Testing and Assessment) on policy and 
govemance issues related to testing and 
assessments. I fiuther serve as staff liaison to 
the APA’s Committee on Psychological Tests 
an Assessment (“CPTA”). Since 2001, 1 have 
served as APA’s primary contact for 
information conceming the availability and 
interpretation of the Standards published in 

1999, and more recently I have done so 
regarding the updated Standards pubhshed in 
2014. 


3. APA is a Dishict of Columbia not-for-profit 
corporation. 

No Objection. 

4. APA is the largest scientific and professional 
organization representing psychology in the 
United States. APA is the world’s largest 
association of psychologists and coimts a vast 
number of researchers, educators, clinicians, 
consultants and students among its members. 
APA’s mission is to advance the creation, 
commimication and application of 
psychological knowledge to benefit society and 
improve people’s lives. 

FRE 402 Relevance. Uie proffered testimony 
does not have any tendency to make a fact of 
consequence more or less probable than it 
would be without the evidence. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opuiion. The proffered 
testimony is a lay opinion that is not rationally 
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based orr the witness’s perception; is not 
helpfitl to clearly imderstanding the witness’s 
testimony or to determining a fact in issue, 
mcludmg because the proffered testimony is 
conclirsory; or is based on scientific, technical, 
or other specialized knowledge within the 
scope of Rule 702. 

5. In 1954, APA prepaied and published the 
“Technical Reconunendations for Psychological 
Tests and Diagnostic Techniques.” It is my 
imderstanding that in 1955 AERA NCME 
prepared and published a companion docimient 
entitled, “Technical Reconunendations for 
Achievement Tests.” 

ERE 402 Relevance. Tire witness’s 
imderstanding of the facts is not relevant. 

ERE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter, particularly 
for any time period prior to her employment 
with the APA in May 2001 . 

6. Subsequently, a joint committee of the three 
organizations modified, revised and 
consolidated the two documents into the first 
Joint Standards. Reginning with the 1966 
revision, the three organizations (AERA, APA 
and NCME) collaborated m developing the 
“Joint Standards” (or simply, the “Standards”). 
Each sirbseqirent revision of the Standards has 
been carefitl to cite the previoirs Standards and 
note that it is a revision and irpdate of that 
docirment. 

ERE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter, particularly 
for any time period prior to her employment 
with the APA in May 2001 . 
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7. Beginning in the mid-1950s, AERA, APA, 
and NCME foiined and periodically 
reconstituted a committee of experts in 
psychological and educational assessment, 
chai ged with the initial development of the 
Technical Recommendations and then each 
subsequent revision of the (renamed) Standards. 
These committees were fomied by the 

Plaintiffs’ Presidents (or then' designees), who 
would meet and jointly agiee on the 
membership. Often a chah or co-chaus of these 
committees were selected by joint agr eement. 
Begiimiug with the 1966 version of the 

Standards, tliis committee became referred to as 
the “Joint Coumiittee.” 

ERE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
wihiess’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter, particular ly 
for any time period prior to her employment 
with APA in May 200 1 . 

ERE 701 Improper Lay Opmion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpftil to clearly imderstanding the witness’s 
testimony or to determining a fact in issue, 
including because the proffered testimony is 
conclusory; or is based on scientific, technical, 
or other specialized knowledge within the 
scope of Rule 702. 

8. Financial and operational oversight for the 
Standards’ revisions, promotion, distribution, 
and for the sale of the 1999 and 2014 Standards 
has been imdertakeu by a periodically 
reconstihited Management Committee, 
comprised of designees of the three Sponsoring 
Organizations. 

ERE 602 Lack of Personal Knowledge. The 
proffered testunony is not based on the 
witness’s personal knowledge of the matter 
and the proffering parly has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter, particularly 
for any time period prior to her employment 
with APA in May 200 1 . 

9. All members of the Joint Committee(s) and 
the Management Comniittee(s) are wipaid 
vohmteers. The expenses associated with the 
ongoing development and publication of the 
Standards include ftavel and lodging expenses 
(for the Joint Committee and Management 
Committee members), support staff time, 
printing and shipment of boimd volumes, and 
advertising costs. 

ERE 403 Prejudice. The testimony omits any 
relevant timefiame, which conftises the issues, 
and it fails to acknowledge or discuss the 
expenses that a large nmnber of impaid 
vohmteers and theh employers bore in the 
drafting of the Standar ds. 

ERE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
wihiess’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter, particular ly 
for any time period prior to her employment 
with APA in May 200 1 . 
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10. Many different fields of endeavor rely on 
assessments. The Sponsoring Organizations 
have ensmed that the range of these fields of 
endeavor is represented in the Joint 

Committee’s membership e.g., admissions, 
achievement, clinical coimseling, educational, 
licensing-credentialing, employment, policy, 
and program evaluation. Similarly, the Joint 
Committee’s members, who are unpaid 
volwiteers, represent expertise across major 
fimctional assessment areas e.g., validity, 
equating, reliability, test development, scoring, 
repoiliug, interpretation, and large scale 
interpolation. 

FRE 403 Prejirdice. The testimony omits any 
relevant timeframe, which confiises the issues. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter, particular ly 
for any time period prior to her employment 
with APA in May 200 1 . 

FRE 701 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfirl to clearly imderstanding the witness’s 
testimony or to determining a fact in issue, 
including because the proffered testimony is 
conclusory; or is based on scientific, technical, 
or other specialized knowledge within the 
scope of Rule 702. 

1 1 . From the time of then initial creation to the 
present, the preparation of and periodic 
revisions to the Standards entail intensive labor 
and considerable cross-disciplinary expertise. 
Each time the Standards are revised, the 
Sponsoring Organizations select and anauge for 
meetings of the leading airthorities in 
psychological and educational assessments 
(known as the Joint Committee). Dining these 
meetings, certain Standards are combined, 
pared down and/or augmented, others are 
deleted altogether, and some are created as 
whole new individual Standards. The 1999 
version of the Standards is nearly 200 pages and 
took more than five years to complete. 

FRE 403 Prejudice. The testimony omits any 
relevant timeframe, which confiises the issues. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not intr oduced 
sufficient evidence to show the witness has 
personal knowledge of this matter, particular ly 
for any time period prior to her employment 
with APA in May 200 1 . 

FRE 701 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfirl to clearly imderstanding the witness’s 
testimony or to determining a fact in issue, 
including because the proffered testimony is 
conclusory; or is based on scientific, technical, 
or other specialized knowledge within the 
scope of Rule 702. 

FRE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of a 


21 


Case l:14-cv-00857-TSC Document 69-4 Filed 01/21/16 Page 28 of 108 


Declaration of Marianne Ernesto In Support 
of Plaintiffs’ Motion for Summary Judgment 

Defendant-Counterclaimant 
Public.Resource.Org, Inc.’s Objections 


document. 

12. The Standards, however, are not simply 
intended for members of the Sponsoring 
Organizations, AERA, APA, and NCME. The 
intended audience of the Standards is broad and 
cuts across audiences with varying backgrounds 
and different training. For example, the 

Standards also are intended to grride test 
developers, sponsors, prtblishers, and irsers by 
providing criteria for the evahration of tests, 
testing practices, and the effects of test irse. Test 
irser standards refer to those standards that help 
test irsers decide how to choose certain tests, 
interpret scores, or make decisions based on 
tests results. Test users include clinical or 
industrial psychologists, research directors, 
school psychologists, coimselors, employment 
supervisors, teachers, and various 
administrators who select or interpret tests for 
then organizations. There is no mechanism, 
however, to enforce compliance with the 
Standards on the part of the test developer or 
test user. The Standards, moreover, do not 
attempt to provide psychometric answers to 
policy or legal questions. 

ERE 403 Prejudice. The testimony omits any 
relevant timeframe, which confrises the issues. 

ERE 602 Lack of Personal Knowledge. The 
proffered testuuony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter, particularly 
for any time period prior to her employment 
with APA in May 2001, or for the goals or 
intent of the Standards, which she did not 
author. 

ERE 701 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfiil to clearly imderstanding the witness’s 
testimony or to determining a fact in issue, 
including because the proffered testimony is 
conclusory; or is based on scientific, technical, 
or other specialized knowledge witliiu the 
scope of Rule 702. 

ERE 702 Umeliable Expert Opinion. The 
proffered testimony on the goals, intent, and 
operation of the Standards is an expert opinion 
by a witness who is not qualified as an expert 
by knowledge, skill, experience, training, or 
education. The testimony fiuther will not help 
the trier of fact to imderstand the evidence or 
to determine a fact in issue; is not based on 
sufficient facts or data; is not the product of 
reliable principles and methods; and is not 
based on the expert’s reliable application of 
reliable principles and methods to the facts of 
the case. 

ERE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of a 
document. 

13. The Standards apply broadly to a wide 

ERE 402 Relevance. The proffered testimony 
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range of standardized mstniinents and 
procedmes that sample an individual’s 
behavior, including tests, assessments, 
inventories, scales, and other testing vehicles. 
The Standards apply equally to standardized 
multiple-choice tests, perfonnance assessments 
(including tests comprised of only open-ended 
essays), and hands-on assessments or 
suuulations. Tlie main exceptions are that the 
Standards do not apply to imstandardized 
questioimaues {e.g., imstnictiued behavioral 
checklists or observational forms), teacher- 
made tests, and subjective decision processes 
(e.g., a teacher’s evaluation of students’ 
classroom paificipation over the coiuse of a 
semester). 


concerning the types of testing the standards 
apply to does not have any tendency to make a 
fact of consequence in this litigation more or 
less probable than it would be without the 
evidence. 

FRE 403 Prejudice. The testimony omits any 
relevant tunefiame and does not specify which 
editions of the Standards are refeiied to, which 
confiises the issues. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
srrfficient evidetrce to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opurion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpflil to clearly imderstanding the witness’s 
testimony or to deternrinmg a fact in issire, 
inchrdurg because the proffered testimony is 
conclusory; and is based on scientific, 
technical, or other specialized knowledge 
within the scope of Rirle 702. 

FRE 702 Umeliable Expert Opinion. The 
proffered testimony on the application of the 
Standards is an expert opinion by a witness 
who is not qiralified as an expert by 
knowledge, skill, experience, training, or 
edrrcation. The testimony fiuther will not help 
the trier of fact to imderstand the evidence or 
to determuie a fact m issire; is not based on 
sufficient facts or data; is not the prodirct of 
reliable principles and methods; and is not 
based on the expert’s reliable application of 
reliable principles and methods to the facts of 
the case. 


14. The Standards have been used to develop FRE 402 Relevance. Tire proffered testunony 

testing guidelines for such activities as college concerning the use of the Standards does not 
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admissions, personnel selection, test 
translations, test user qualifications, and 
computer-based testing. The Standards also 
have been widely cited to address technical, 
professional, and operational noiins for all 
fonns of assessments that are professionally 
developed and used in a variety of settuigs. Tlie 
Standards additionally provide a valuable public 
seiwice to state and federal governments as they 
vohmtarily choose to use them. For instance, 
each testing company, when submitting 
proposals for testing administration, instead of 
relying on a patchwork of local, or even 
individual and proprietaiy, testing design and 
implementation criteria, may rely instead on the 
Sponsormg Organizations’ Standards to afford 
the best guidance for testing and assessment 
practices. 

have any tendency to make a fact of 
consequence in this litigation more or less 
probable than it would be without the 
evidence. 

FRE 403 Prejudice. The testimony omits any 
relevant timeframe, which confrises the issues. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering paify has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opmion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfril to clearly imderstanding the witness’s 
testimony or to deteimining a fact in issue, 
mcludmg because the proffered testimony is 
conclusory; or is based on scientific, technical, 
or other specialized knowledge within the 
scope of Rule 702. 

FRE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of 
documents. 

15. The Standards were not created or updated 
to serve as a legally binding document, in 
response to an expressed governmental or 
regulatoiy need, nor in response to any 
legislative action or judicial decision. However, 
the Standards have been cited injudicial 
decisions related to the proper use and evidence 
for assessment, as well as by state and federal 
legislators. Tliese citations injudicial decisions 
and diuuig legislative deliberations occuned 
without any lobbying by the Plaintiffs. 

FRE 403 Prejudice. The testimony omits any 
relevant timeframe, which confrises the issues 
as to which editions of the Standards and 
which years the witness is refeiiuig to. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering paity has not mtioduced 
sufficient evidence to show the witness has 
personal knowledge of this matter, paiticulaily 
as to the goals of the many authors of the 
Standards. 

FRE 701 Improper Lay Opmion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception and is not 
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help fill to clearly imderstanding the witness’s 
testimony or to deteimining a fact in issue, 
including because the proffered testimony is 
conchrsory. 

ERE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of a 
document. 

16. During the discoveiy phase of this litigation, 
APA located in its archives coirespondence 
relating to APA’s support for proposed 
legislation sought to be introduced in 2001 by 
Senator Paul Wellstone (D-MN) on Fauness 
and Acciuacy in High Stakes Educational 
Decisions for Students - a suggested 
amendment to the Elementary and Secondary 
Edrrcation Act (“No Child Left Behind Act”) 

147 Cong. Rec. S. 4,644 (daily ed. May 9, 

2001). 

ERE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of a 
document. 

17. Accompanying this Declaration as 

Exhibit NN is a tnre copy of a signed 
correspondence between Ellen Garrison Ph.D. 
and Patricia Kobor of APA and Ms. Jill 
Moniingstar, Legislative Assistant to U.S. 
Senator Pairl Wellstone dated April 7, 2000, 
marked as Exhibit 1109 dining my deposition. 

No Objection. 

18. Accompanying this Declaration as 

Exhibit OO is a tnre copy of an imsigned 
correspondence between Ellen Garrison Ph.D. 
and Patricia Kobor of APA and Ms. Jill 
Moniingstar, Legislative Assistant to 

U.S. Senator Paul Wellstone dated April 7, 

2000, marked as Exhibit 1110 dining my 
deposition. 

No Objection. 
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19. Accompanying tliis Declaration as 

Exhibit PP is a tme copy of a signed 
correspondence between Patricia Kobor and 

Ellen Garrison, Ph.D. of APA and Ms. Jill 
Momingstar, Legislative Assistant to 

U.S. Senator Paul Wellstone dated April 13, 
2000, marked as Exhibit 1111 dining my 
deposition. 

No Objection. 

20. Accompanying this Declaration as 

Exhibit QQ is a true copy of an unsigned 
coirespondence between Raymond D. Fowler, 
Ph.D. of APA and an unnamed Senator dated 
May 7, 2001, marked as Exhibit 1114 dining 
my deposition. 

No Objection. 

2 1 . Accompanying tliis Declaration as 

Exhibit RR is a true copy of an imsigned 
correspondence between L. Michael Honaker, 
Ph.D. of APA and an unnamed Senator dated 
March 6, 2001, marked as Exhibit 1115 dining 
my deposition. 

No Objection. 

22. Accompanying this Declaration as 

Exhibit SS is a tine copy of a document 
containing “Highlights of APA’s Involvement 
in Educational Testing Provisions of the 
‘No Child Left Behind Act’” that also contains 
an imsigned coirespondence to an unnamed 
Senator dated May 7, 2001, marked as 

Exhibit 1116 dming my deposition. 

No Objection. 

23. As noted above, many of these letters are 
imsigned and are not printed on APA letterhead. 
Therefore, in accordance with APA practices 
and protocols, it is likely that the imsigned 
letters (not printed on letterhead) were internal 
discussion drafts that were never sent. 

ERE 403 Prejudice. The witness’s belief as to 
what is “likely” is less probative than 
prejudicial, and risks confusing the issues and 
misleading the factfinder. 

ERE 602 Lack of Personal Knowledge. The 
proffered testimony is explicitly speculative 
and is not based on the witness’s personal 
knowledge of the matter and the proffering 
paity has not introduced sufficient evidence to 
show the witness has personal knowledge of 
tliis matter, particularly as to docimients 
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created by other individuals, and documents 
created prior to her employment with APA iu 

FRE 701 Improper Lay Opmion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfiil to clearly imderstanding the witness’s 
testimony or to detemiining a fact in issue, 
including because the proffered testimony is 
conclusory; or is based on scientific, technical, 
or other specialized knowledge witliin the 
scope of Rule 702. 

FRE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of a 
document. 

24. Regarding the signed letters that were 
printed on APA letterhead, they relate to 

Senator Wellstone’s proposed legislation that 
tests and assessments administered by the states 
are of high quality and used appropriately for 
the benefit of test administiators and test takers. 
These are goals that are consistent with APA 
policy as then reflected in the 1999 Standards. 
Even though Senator Wellstone’s amendments 
sought, in part, to mandate states’ compliance 
with the Standards, none of the Sponsoriug 
Organizations actively advocated for this - and 
in any event Senator Wellstone’s proposed 
amendment mcluding this language was never 
enacted into law. Accompanying this 

Declaration as Exhibit TT is a tine copy of 

20 U.S.C. § 6301, which is the ciuient version 
of the legislation Senator Wellstone sought to 
amend. 

FRE 402 Relevance. Tlie relevant issue is 
whether the APA lobbied iu support of Senator 
Wellstone’s proposed amendments mandating 
compliance with the 1999 Standards, not 
whether the proposed amendments were 
imsuccessfixl notwithstandiug the APA’s 
lobbying activity. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering paily has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter, particulaily 
as to documents created by other individuals, 
and dociuuents created prior to her 
employment with APA in May 2001. 

FRE 701 Improper Lay Opmion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 


27 


Case l:14-cv-00857-TSC Document 69-4 Filed 01/21/16 Page 34 of 108 


Declaration of Marianne Ernesto In Support 
of Plaintiffs’ Motion for Summary Judgment 

Defendant-Counterclaimant 
Public.Resource.Org, Inc.’s Objections 


help fill to clearly imderstanding the witness’s 
testimony or to deteiinining a fact in issue, 
including because the proffered testimony is 
conclusoiy; or is based on scientific, technical, 
or other specialized knowledge within the 
scope of Rule 702. 

FRE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of a 
document. 

25. APA’s search of its records did not disclose 
any ftuther communications with Congress 
relating to the Standards and, to the best of 
APA’s knowledge, it has not engaged in 
commimications with Congress regarding 
citation of the Standards in legislation since 

2001. 

FRE 403 Prejudice. The probative value of the 
proffered testimony is substantially 
outweighed by a danger of imfair prejudice, 
confiising the issues, and misleading the 
factfinder, because it omits mention of other 
documents concerning APA’s commimication 
with Congress relating to the Standards that 
were discussed at deposition, as well as other 
coimuimications with other policymakers. See, 
e.g. ICE Exs. J, 47^9 (Plaintiffs’ briefing on 
the 2014 Standards at the Russell Senate 

Office Building on Capitol Hill on September 
12,2014). 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge’ of this matter, particularly 
as to documents created by other individuals. 


FRE 701 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfiil to clearly imderstanding the witness’s 
testimony or to determining a fact in issue, 
including because the proffered testimony is 
conclusory; or is based on scientific, technical, 
or other specialized knowledge within the 
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scope of Rule 702. 

26. APA has not solicited any goveiimieut 
agency to incoiporate the Standards into the 

Code of Federal Regulations or other rales of 
Federal or State agencies. 

FRE 403 Prejudice. The testimony omits any 
relevant timeframe, which confrises the issues 
as to which editions of the Standards and 
which years the witness is refening to. 
Moreover, Plaintiffs refrised to provide 
discovery concerning any edition of the 
Standards other than the 1999 Standards, and it 
woitld be imfairly prejirdicial to allow them to 
mtrodrrce testimony on the 2014 Standards or 
other editions at summary jirdgment. 

FRE 602 Lack of Personal Knowledge. The 
proffered testuuony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introdirced 
srrfficient evidence to show the witness has 
personal knowledge of this matter, particirlarly 
as to any time period before she was employed 

FRCP 26(a) and 37 Withheld Evidence. 

Plaintiffs refrtsed to provide evidence or 
testimony concerning any edition of the 
Standards other than the 1999 Edition, and 
redacted docirments that inchrded data 
concerning the 1985 and 2014 editions of the 
Standards. See ICE Ex. 62 
(Plaintiffs/coimterclaim-defendants’ 

Objections and Answers to 
Defendant/coimterclaim-plaintiff s Fust Set of 
Intenogatories (Nos. 1-10) (objecting to 
prodirction of docrrments concerning any 
pirblications other than the 1999 Standards and 
stating that sirch documents are UTelevant)); 

ICE Ex. 63 (conespondence PRO coimsel 
identifying ear lier versions and redactions as 
issues in discovery). Plaintiffs shoitld not be 
allowed to now testify on matters they refrtsed 
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to allow discovery into. 

27. Rather, in the policymaking arena, APA 
believes the Standards should be heated as 
guidelines infomiing the enactment of 
legislation and regulations consistent with best 
practices in the development and use of test - to 
insme that they are valid, reliable and fan. 

ERE 403 Prejitdice. The testimony omits any 
relevant timeframe, which confrrses the issires. 
This may, for instance, be APA’s belief now, 
birt was not APA’s belief at the time it lobbied 
for the 1999 Standards to be mandated by law 
in 2001. 

28. Plaintiffs promote and sell copies of the 
Standards via refeiTals to the AERA website, at 
annual meetings, in public offerings to shidents, 
and to educational instihition faculty. 
Advertisements promoting the Standards have 
appeared in meeting brochmes, in scholarly 

ERE 403 Prejitdice. The testimony omits any 
relevant timefr ame and does not specify which 
editions of the Standards are referred to, which 
confrrses the issires. Plaintiffs ceased selling 
and promoting the 1999 Standards in 2014, 
andotilyresiunedsellin2itinJuly201^^^B 

joimials, and in the hallways at professional 
meetings. Accompanying this Declaration as 
Exhibit UU is a tnie copy of an advertisement 
for the 1999 Standards that appeared in the 
December 1999 issue of APA’s Joiuiial of 
Educational Psychology. 


29. Distribution of the Standards is closely 
monitored, by the Sponsoring Organizations. 
AERA, the designated publisher of the 

Standards, sometimes does provide promotional 
complementary print copies to shrdents or 
professors. Except for these few complementary 

ERE 403 Prejudice. The testimony omits any 
relevant timeframe and does not specify which 
editions of the Standards is referred to, which 
confrrses the issues. Plaintiffs ceased selling 
and promoting the 1999 Standards in 2014, 

print copies, however, the Standards are not 
given away for free; and certainly they are not 
made available to the prrblic by any of the three 
organizations for anyone to copy fr ee of charge. 

ERE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering parly has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter, particularly 
as to any time period before she was employed 
by APA in May 2001, and the activities of the 
other Plaintiffs. 
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30. To date, the Sponsomig Organizations have 
never posted, or authorized the posting of, a 
digitized copy of the 1999 Standards on any 
publicly accessible website. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering paity has not intioduced 
sufficient evidence to show the witness has 
personal knowledge of this matter, particulaiiy 
as to any time period before she was employed 
by APA in May 2001, and the activities of the 
other Plaintiffs. 

3 1 . The Sponsoring Organizations do not keep 
any of the revenues generated from the sales of 
the Standards. Rather, the income from these 
sales is used by the Sponsoiing Organizations 
to offset then development and production costs 
and to generate frmds for subsequent revisions. 
This allows the Sponsoiing Organizations to 
develop up-to-date, high quality Standards that 
otherwise would not be developed due to the 
time and effort that goes into producing them. 

FRE 403 Prejudice. The statement that the 
Plaintiffs do not “keep” any of the revenues, 
but use them for certain operating expenses, is 
incomplete and misleading, because Plaintiffs 
do keep the revenues but simply earmark them 
for particular piuposes. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter, particularly 
as to any time period before she was employed 
by APA, and the activities of the other 

Plaintiffs. 

FRE 701 Improper Lay Opinion. The proffered 
testimony as to the effects and necessity of 
Plaintiffs’ financing model is a lay opinion that 
is not rationally based on the witness’s 
perception; is not helpfirl to clearly 
imderstanding the witness’s testimony or to 
detemiining a fact in issire, inchrding becaitse 
the proffered testimony is conchrsory; or is 
based on scientific, teclmical, or other 
specialized knowledge within the scope of 

Ritle 702. 

FRE 702 Umeliable Expert Opinion. The 
proffered testimony is an expert opinion by a 
witness who is not qiralified as an expert by 
knowledge, skill, experience, training, or 
edircation. The testimony fiuther will not help 
the trier of fact to imderstand the evidence or 
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to deteiinuie a fact m issue; is not based on 
sufficient facts or data; is not the product of 
reliable principles and methods; and is not 
based on the expert’s reliable application of 
reliable principles and methods to the facts of 
the case. 

32. Without receiving at least some moderate 
income from the sales of the Standards to offset 
then production costs and to allow for fiuther 
revisions, it is very likely that the Sponsoring 
Organizations would no longer imdertake to 
periodically update them, and it is unknown 
who else would. 

FRE 403 Prejudice. The 2014 Standards are 
not implicated by this litigation, and Plaintiffs 
voliuitarily stopped selling the 1999 Standards, 
the only edition at issue. The witness’s 
statement is misleading because it suggests 
without justification or basis that Public 
Resoiu'ce’s actions risk depriving Plaintiffs of 
income fr om the sale of the 2014 Standards. 

Tlie witness’s statement is also speculative and 
risks confiising the issues in this case. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering paity has not infroduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfiil to clearly imderstanding the witness’s 
testimony or to deteimining a fact in issue, 
including because the proffered testimony is 
conclusory; or is based on scientific, technical, 
or other specialized knowledge within the 
scope of Rule 702. 

FRE 702 Umeliable Expert Opinion. The 
proffered testimony is an expeit opinion by a 
witness who is not qualified as an expert by 
knowledge, skill, experience, training, or 
education. The testimony fiuther will not help 
the trier of fact to imderstand the evidence or 
to deteiinuie a fact m issue; is not based on 
sufficient facts or data; is not the product of 
reliable principles and methods; and is not 
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based on the expert’s reliable application of 
reliable principles and methods to the facts of 
the case. 

33. Due to the relative minor portion of the 
membership of APA who devote their careers to 
testing and assessment, it is highly imlikely that 
the members of APA will vote for a dues 
increase to flmd fiitiue Standards revision 
efforts if Public Resoiuce successflilly defends 
this case and is allowed to post the Standards 
online for the public to download or print for 
free. As a result, the Sponsoring Organizations 
would likely abandon their practice of 
periodically updating the Standards. 

FRE 403 Prejudice. The 2014 Standards are 
not implicated by this litigation, and Plaintiffs 
volimtarily stopped selling the 1999 Standards, 
the only edition at issue. The witness’s 
statement is misleading because it suggests 
that Public Resoiuce ’s actions risk depriving 
Plaintiffs of income fr om the sale of the 2014 
Standards. The witness’s statement is also 
speculative and risks confrising the issues in 
this case. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering paify has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfril to clearly imderstanding the witness’s 
testimony or to deteimining a fact in issue, 
including because the proffered testimony is 
conclusory; or is based on scientific, technical, 
or other specialized knowledge within the 
scope of Rule 702. 

FRE 702 Umeliable Expert Opinion. The 
proffered testimony is an expert opinion by a 
witness who is not qualifred as an expert by 
knowledge, skill, experience, tiaining, or 
education. The testimony fruther will not help 
the trier of fact to imderstand the evidence or 
to detennine a fact m issue; is not based on 
sufficient facts or data; is not the product of 
reliable principles and methods; and is not 
based on the expert’s reliable application of 
reliable piinciples and methods to the facts of 
the case. 
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34. The Joint Committee that authored the 1999 
Standards comprised 16 members. Except for 
Manfred Meier (who could not be located, nor 
could his heirs), work made-for-hhe letters 
were signed by 13 Joint Committee Members, 
and posthimious assigimieuts were signed by 
the heirs of 2 deceased Joint Cormnittee 
Members, vesting ownership of the copyr ight to 
the 1999 Standards in the Sponsoring 
Organizations. Accompanying this Declaration 
as Exhibits W-HHH are the 13 work made-for- 
hire letters signed by Eva Baker, Lloyd Bond, 
Daniel Goh, Ber1 Green, Edward Haerfel, Jo-Ida 
Hansen, Suzatme Lane, Sharon Johnson-Lewis, 
Joseph Matarazzo, Pamela Moss, Esteban 
Olmedo, Diana Pulliu, and Paul Sackett, 
marked as Exhibits 1065, 1069, 1071, 1072. 
1075, 1078, 1082, 1085, 1086, 1089, 1090, 

1091, and 1094 dining my deposition. 
Accompanying tliis Declaration as Exhibits III 
and JJJ are the posthumous assigrmients signed 
by the heirs of Leonard S. Feldt and Charlie 
Spielberger, marked as exhibits 1070 and 1097 
dining my deposition. 


Defendant-Counterclaimant 
Public.Resource.Org, Inc.’s Objections 

ERE 403 Prejudice. The witness’s testimony is 
misleading and conftises the issues. 17 
individuals participated in the Joint Commit tee 
fo^h^99^Standatds^o^^^^^^^^J 

Additionally, the witness fails to mention that 
himdreds of individuals, organizations, and 
other entities participated in the development 
of the 1999 Standar ds in collaboration wi th the 

Moreover, the witness’s opinion as to the legal 
effect of these alleged “work-made-for-hire 
letters” and “posthumous assignments” is 
prejudicial. 

ERE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

ERE 701 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfril to clearly imderstanding the witness’s 
testimony or to determining a fact in issue, 
including because the proffered testimony is 
conclusory; or is based on scientific, technical, 
or other specialized knowledge witliin the 
scope of Rule 702. 

ERE 702 Umeliable Expert Opinion. The 
proffered testimony is an expert opinion by a 
witness who is not qualified as an expert by 
knowledge, skill, experience, training, or 
education. The testimony fiuther will not help 
the trier of fact to imderstand the evidence or 
to determine a fact in issue; is not based on 
sufficient facts or data; is not the product of 
reliable principles and methods; and is not 
based on the expert’s reliable application of 
reliable principles and methods to the facts of 
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the case. 

FRE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of a 
document. 

35. Public Resoiuce posted Plaintiffs’ 1999 
Standards to its website and the Internet 

Archive website without the permission or 
authorization of any of the Sponsoring 
Organizations. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introdirced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

36. Past haini from Public Resource’s 
infr mgmg activities includes misuse of 

Plaintiffs’ intellectual propeity without 
peimission. 

FRE 403 Prejudice. The witness’s testimony is 
misleading and confrises the issues by alleging 
that Public Resoiuce’s activities were 
infringing, and suggesting that Public 

Resource should have obtamed permission to 
use the 1999 Standards incorporated by 
reference and that Plaintiffs coirld be harmed 
by sirch irse. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not irrtrodirced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opmion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfrtl to clearly rmderstanding the witness’s 
testimony or to determining a fact in issue, 
including becairse the proffered testimony is 
conclusory; or is based on scientific, technical, 
or other specialized knowledge within the 
scope of Rirle 702. 

FRE 702 Umeliable Experf Opinion. The 
proffered testimony is an expert opmion by a 
witness who is not qualified as an expert by 
knowledge, skill, experience, training, or 
edircation. The testimony fiuther will not help 
the trier of fact to imderstand the evidence or 
to determuie a fact m issire; is not based on 
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sufficient facts or data; is not the product of 
reliable principles and methods; and is not 
based on the expert’s reliable application of 
reliable prmciples and methods to the facts of 
the case. 

37. Should Public Resoiuce’s infringement be 
allowed to continue, the haiin to the Sponsoiing 
Organizations, and public at large who rely on 
the preparation and administr ation of valid, fan 
and reliable tests, includes: (i) imcontiolled 
publication of the 1999 Standards without any 
notice that those guidelines have been replaced 
by the 2014 Standards; (ii) futine imquantifiable 
loss of revenue fr om sales of authorized copies 
of the 1999 Standards (with proper notice that 
they are no longer the cmient version) and the 
2014 Standards; and (iii) lack of frmding for 
fufrne revisions of the 2014 Standards and 
beyond. 

FRE 403 Prejudice. The 2014 Standards are 
not at issue in this litigation, and Plaintiffs 
vohmtaiily stopped selling the 1999 Standards, 
the only edition at issue. The witness’s 
statement is misleading because it suggests 
that Riblic Resomce’s actions risk depriving 
Plaintiffs of income fr om the sale of the 2014 
Standards. The witness’s statement is also 
speculative and risks confiising the issues in 
this case. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sirffrcient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opmion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfirl to clearly imderstanding the witness’s 
testimony or to detennining a fact in issrre, 
inchrding because the proffered testimony is 
conchrsory; or is based on scientific, technical, 
or other specialized knowledge witliin the 
scope of Rirle 702. 

FRE 702 Umeliable Experl Opinion. The 
proffered testimony is an expert opmion by a 
witness who is not qiralified as an expert by 
knowledge, skill, experience, training, or 
edircation. The testimony fiuther will not help 
the trier of fact to imderstand the evidence or 
to determine a fact in issire; is not based on 
sirffrcient facts or data; is not the product of 
reliable principles and methods; and is not 
based on the expert’s reliable application of 
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reliable piinciples and methods to the facts of 
the case. 


IV. OBJECTIONS TO THE DECLARATION OF KURT E. GEISINGER IN 

SUPPORT OF PLAINTIFFS’ MOTION FOR SUMMARY JUDGMENT AND 
ENTRY OF A PERMANENT INJLTVCTION 


Declaration of Kurt F. Geisinger In Support 
of Plaintiffs’ Motion for Summary Judgment 

Defendant-Counterclaimant 

Public Resource’s Objections 

1. 1 am ciuiently Dir ector of the Biuos Center 
on Testing and W. C. Meierhemy Distinguished 
University Professor at the University of 
Nebraska-Liucohi. I submit this Declaration in 
support of the motiorr of the American 
Edircational Research Association, Inc. 
(“AERA”), the American Psychological 
Association, Irrc. (“APA”), and the National 
Cormcil on Measruemeut irr Edrrcation, Inc. 
(“NCME”) (collectively, ‘■‘Plaintiffs” or 
“Sponsoring Organizations”) for srrmmary 
judgment and the entry of a permanent 
injrmction. 

No Objection. 

2. My cirrricirhrm vitae is attached to this 
Declaration as Exhibit 1 . 

No Objection. 

3. 1 received my doctoral degree in Edrrcational 
Psychology in 1977 from the Permsylvania 

State University, after previously receiving my 
masters’ degree in Psychology at the University 
of Georgia and my bachelor’s degree from 
Davidson College (with honors). I also stirdied 
German, Psychology and other topics as an 
rmdergradrrate at the Phillips Universitat in 
Marbrug, Germany and at Harward University 
when I attended the Institirte for Edircational 
Management in 1995. 

No Objection. 

4. From 2001 to 2006, 1 served as the Vice 
President of Academic Affairs and Professor of 

No Objection. 
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Public Resource’s Objections 

Psychology at the University of St. Thomas in 
Houston, Texas, where I was responsible for 
foin academic schools, approximately 200 
faculty members, and over 4,000 students. From 
1997 to 2001, 1 served as Academic Vice 
President and Professor of Psychology at 

Le Moyne College. From 1992 to 1997 I serwed 
as Dean of the College of Arts and Sciences and 
Professor of Psychology at the State University 
of New York at Oswego. And, from 1977-1992 

I served as a Professor of Psychology at 

Fordham University in New York City, where I 
serwed as department chair for the Department 
of Psychology and director of the Doctoral 
program in Psychometrics. 


5. Over the past forty years, I have researched, 
studied, and taught psychometr ics 
(psychomehics is the quantitative study of tests 
and measmes in terms of the value, usefrilness, 
and interpretation of the results of such 
measmes). I also am a fellow, diplomate, and 
member of numerous professional societies 
involving educational and psychological testing, 
such as the APA (fellow), the American 
Association for Assessment Psychology 
(diplomate), the AERA (fellow), and the 

NCME, as well as other professional 
associations. I have represented the APA by 
seiwing on and chairing the Joint Committee on 
Testing Practices (which is separate from the 
APA committee responsible for the 1999 
Standards for Educational and Psychological 
Testing) and have served on the APA’s 
Committee on Psychological Testing and 
Assessment. In 2010, 1 was elected to serwe two 
terms (2006-2008 and 2009-2011) as the 
representative on the Coimcil of 

Representatives for the APA’s Division of 
Evaluation, Measmemeut arrd Statistics. My 
second term was cut short by one year when I 
was elected to serwe as a member-at-large on 
the APA’s Board of Directors irr 2010, a 

No Objection. 
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position I held for a three-year teim (201 1- 
2013). 

Defendant-Counterclaimant 

Public Resource’s Objections 

6. 1 have authored niunerous publications about 
psychological and educational testing. I have 
worked at the Educational Testing Service 
(“ETS”), chaiied its Technical Advisory 
Committee for the Graduate Record 

Examination (“GRE”), served on the Board of 
Directors for the GRE (a Board that I also 
chair ed), and have been a member of the 

College Board, (formerly known as the College 
Entrance Exanrination Board) for which I 
served (2000-2002) on its SAT Conuuittee. I 
recently conchrded a foirr-year term (201 1- 
2014) on the Advisory Research Conrmittee for 
the College Board, serving the last two years as 
its chair. I cimently serve on the Technical 
Advisory Committee for the Edircational 

Records Biueair^ and on Saudi Arabia’s 
luteniational Advisory Board for its National 
Center for Assessment and Evahration. 

No Objection. 

7. In 2010, 1 was elected to the Coimcil (i.e.. 
Board of Directors) for the International Test 
Corimiission — the primary international testing 
body. In 2012, 1 was also elected as its 

Treasirrer and to serve on its Executive Cotmcil. 

I am the only American who serves on its 
Execirtive Coimcil. 

No Objection. 

8. 1 was asked to review and share my 
comments’ [ 5 /c] chapters of the 1999 Standards 
for Educational and Psychological Testing, 
published jointly by the AERA, the APA, and 
the NCME (the “1999 Standards”). The 
Standards^ embody the professionally accepted 

ERE 402 Relevance / ERE 403 Prejudice. The 
testimony omits reference to any relevant 
timeframe, and witness’s use of the term 
“Standards” without referencing a particular 
edition or relevant timeframe confuses the 
issues. 


'y 

The Educational Record Bmeau speciahzes in the development and use of tests and testing 
products for private and independent educational institutions at the p-12 levels. 

I use the term "'Standards ” to refer to the Standards for Educational and Psychological Testing 
as a whole, not a specific version of the Standards, i.e. 1999 or 2014. 
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Public Resource’s Objections 

practices for testing and measurement. One of 
the chapters I reviewed was based upon the 
testing of individuals with disabilities, an area 
in which I have engaged in research and have 
served as an expert witness in federal coiuts as 
well as state coiuts in New York, New Jersey, 
and California. 


9. In addition to my 130 plus jomnal articles 
and book chapters, I have written, edited, or co- 
edited approximately 1 5 books and 
monographs. The vast majority of these 
publications deal with testing and measiuement 
issues. For example, I have edited two books on 
the psychological testing of Hispanics and 
another I co-edited related to fairness in testing. 

I have also co-edited several books of reviews 
of published tests and measm es. I was also 
Editor-in-Chief for the three-volume Haudbook 
of Testing and Assessment in Psychology’ 
(published by the APA in 2013) and have been 
editor of the jomnal Applied Measurement in 
Education for the past 9 plus years. Taylor & 
Francis, in conjunction with the Bmos Center 
for Testing publishes this jomnal. 

No Objection. 

10. 1 also co-chaued a sub-committee of the 
APA’s Jomt Committee on Testing Practices 
and the overall committee itself that developed 
a document on the riglrts and responsibilities of 
test takers (1993-2001). This document has 
been endorsed by a number of professional 
associations related to proper test use, including 
the APA, the National Association of School 
Psychologists, the American Coimseling 
Association, and the NCME. Wlrile chahiug the 
Joint Committee on Testing Practices, the 
cormuittee developed a book entitled Assessing 
Individuals with Disabilities^ in which I wrote a 
chapter. I also served on a task force charged to 
illmninate issues related to the testing of 
individirals with disabilities as well as ethnic 
minorities The task force wrote and edited a 

No Objection. 
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book entitled Test Ifiterpretation and Diversity: 
Achieving Equity in Assessmeirt, which was 
published by the APA’s publication unit in 

1997. 1 had three chapters in that volinne. 

Defendant-Counterclaimant 

Public Resource’s Objections 

1 1 . 1 additionally served on an APA task force 
(2007-2010) that considered the assessment and 
intervention of individuals with disabilities. The 
results of om' work. Guidelines for the 
“Assessment of and Intervention with 

Individrrals with Disabilities,” was pirblished in 
the American Psychologist, the premier 
prrblicatiou of the APA (Geisinger et al., 2012) 
and endorsed as the policy of the APA by its 
governance. A reference for the American 
Psychologist article may be formd on my 
crmicrrlirm vitae, which is attached as Exliibit 1 . 

No Objection. 

12. In the past two years (2014-2015), I have 
served on two task forces related to the rtse of 
measrrres in clinical psychology. One of these 
has written a policy, recently accepted by the 
APA’s Board of Directors, that differentiates 
the use of tests and other measrrres, for 
screening and assessment, two liighly related 
types of testing, birt which differ in specificity 
and focus. Tests are rrsrrally standardized 
measures that ar e given to a nirmber of people 
for a specific pirrpose. A bar' examination woitld 
be an example of a test. Measmes are other 
variables yielding typically qrrautitative vahres 
that are rtsed to evahrate a person and inclitde 
tests. A bathroom scale resrrlts itr a measiue 
(weight), brrt would not normally be considered 
as a test. 

No Objection. 

13. Drrriug 2013-2014, 1 served on a committee 
of the Institirte of Medicine (a component of the 
Natiorral Academy of Sciences) that evahrated 
the itse of psychological and clinical 
nemopsychological measmes by the Social 
Seciu'ity Administration in determining 

No Objection. 
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Public Resource’s Objections 

disability status. The final repoit, entitled 
Psychological Testing in the Set-vice of 

Disability Determination, has been pubhshed 
by the National Academy of Sciences and is 
also available from the Institute of Medicine’s 
website. 


14. For approximately foin years (2008-2012), I 
jointly represented three professional 
associations (the AERA, the APA, and the 
NCME) in developing the International 

Standaids Organization’s (“ISO”) fust standaid 
on psychological testing. The results of the 
work of the committee that engaged in this 
activity was ISO Standaid 10677. The standard 
is divided into two parts. The fust establishes 
requhements and guidance for a client working 
with a service provider to cany out the 
assessment of an individual, a group, or an 
organization for work-related pmposes. ISO 
10667-1:201 1 enables the client to base its 
decisions on soimd assessment results. ISO 
10667-1:201 1 also specifies the responsibilities 
of a service provider in teims of the assessment 
methods and procedines that can be canied out 
for vaiious work-related pmposes made by or 
affecting individuals, gioups or organizations. 

No Objection. 

15.1 also built or helped to build a niuuber of 
testing measiues. Specifically, I seiwed as the 
primary consultant on a number of civil service 
examinations given in New York City for police 
officers, sergeants, lieutenants, and captains, 
fire fighters, fire lieutenants, fire captains, 
sanitation supeiwisors, and a variety of other 
civil service occupations over a period of at 
least a decade ending in 1992. 1 sometimes 
defended these measmes in comt. I also 
represented the Public Service Alliance of 
Canada against the Public Service of Carrada in 
two cases related to then national testing efforts 
and assisted Disability Rights Advocates with 
regard to several testing dispirtes concerning 

FRE 402 Relevarrce. The witness’s prior 
experierrce as arr expert orr testirrg issires is not 
relevant to his opirrions in this case, which 
concerns alleged harm to Plaintiffs. 
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Public Resource’s Objections 

individuals with disabilities. See Exh. 1. 


16. In recent years, my primary efforts have 
been to assiue testing famiess for those with 
disabilities, langirage minorities, and ethnic 
minorities. 

ERE 402 Relevance. Uie witness’s prior- 
experience with testing issues is not relevant to 
his opinions in this case, which concerns 
alleged harm to Plamtiffs. 

17. 1 first learned about the Standards for 
Edircational and Psychological Testing wliile I 
was iu my first or second year of gradirate 
school. Urey are widely discirssed in classes on 
testing and testing practice and treated with 
great respect. Some gradirate programs and 
comses requir e that stirdents pmchase the 
Standards as part of then comsework and 
education. In teaching graduate classes on 
topics related to testing and associated with the 
Standards, I often refer to them, building the 
thoughts and approaches described in the 
Standards, as well as specific standards, into my 
lectures and classes. I expect stirdents to 
pmchase and read the Standards in a number of 
the classes I taught. When writing chapters and 
articles on such topics as test validity, test 
reliability, and test fairness — all topics I have 
discirssed in writing — I frequently refer to the 
Standards to check my use of language, my 
interpretations, and to check that I am not 
omitting a topic of importance relevant to the 
specific publication. Also, when building tests, 
such as the Police and Fue Department Civil 
Serwice tests I helped construct for the City of 
New York, or when serwing on technical 
advisory committees for the well-known SAT 
and GRE committees and boards, I refer to the 
Standards frequently. Usually, in meetings I 
attempt to express what I believed to be best 
practices, and then would “back up” my beliefs 
with quotes fr om the specific and relevant 
standards. Perhaps my gr eatest use of the 
Standards has occimed in my legal defense of 
specific tests or in my critique of particular' uses 
of some tests, both of which I have engaged m 

ERE 402 Relevance. Tire witness’s prior- 
experience as an expert on testing issues is not 
relevant to his opinions in this case, which 
concerns alleged harm to Plaintiffs. 

ERE 403 Prejudice. The testimony omits 
reference to any relevant timefr ame, and 
witness’s use of the term “Standards” without 
referencing a particular edition or relevant 
timeframe confirses the issues. 
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Public Resource’s Objections 

dming my career as an expert witness. 


18. The ultimate advantages of the Standards in 
my opinion are that they are written and edited 
by first-rate professionals covering a number of 
the representative fields in wliich testing and 
assessment are primarily employed, they are 
thoroughly and publicly vetted by other 
professionals, and they are openly discussed 
dming the revision process at many 
professional conferences. The resultant 
document becomes a living document of best 
practices. That the members of the committee 
drafting the Standards are generally extremely 
highly respected professionals in the field of 
testing and testing practice also provides the 
Standards great credibility. Given my 
experience over the last 10 years as Director of 
the Bmos Center for Testing, thought of by 
many as the Consmner Reports of the testing 
industry, and my seiwice as the co-editor of the 
Mental Measmements Yearbooks, where 
commercially available tests are evaluated, I 
can state categorically that the Standards serwe 
as the prunary basis for all test evahrations. The 
other editors of these Yearbooks and I refer to 
the Standards with great fieqirency to determine 
and assme oiuselves that the cormnents made 
by reviewers are consistent with the Standards 
and that the reviews themselves are based irpon 
principles supported by, and coherent with, the 
Standards. The Standards originally were 
created as principles and guidelines — a set of 
best practices to improve professional practice 
in testing and assessment across mirltiple 
settings, inchtding edircation and various areas 
of psychology. The Standar ds can and should 
be irsed as a recommended coirrse of action in 
the soimd and ethical development and irse of 
tests, and also to evahrate the qirality of tests 
and testing practices. Additionally, an essential 
component of responsible professional practice 
is maintaining technical competence. Many 

FRE 402 Relevance. Hie witness’s prior- 
experience as an expert on testing issues is not 
relevant to his opinions in this case, which 
concerns alleged har-m to Plaintiffs. 

FRE 403 Prejirdice. The testimony omits 
reference to any relevant timeframe, and 
witness’s use of the term “Standards” without 
referencing a particirlar edition or relevant 
timefiame confuses the issires. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering par-ty has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 
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professional associations also have developed 
standards and principles of technical practice in 
assessment. Tire Sponsoring Organizations’ 
Standards have been and still are used for this 
piupose. 


19. The Standards, however, are not simply 
intended for members of the Sponsoring 
Organizations: AERA, APA, and NCME. The 
intended audience of the Standards is broad and 
cuts across audiences with varying backgioimds 
and different training. For example, the 

Standards also are intended to guide test 
developers, sponsors, publishers, and users by 
providing criteria for the evaluation of tests, 
testing practices, and the effects of test use. Test 
user-oriented standards refer to those standards 
that help test users decide how to choose ceifain 
tests, interpret scores, or make decisions based 
on test results. Test users mclude clinical or 
industrial psychologists, research directors, 
school psychologists, coimselors, employment 
supeiwisors, teachers, and various 
administrators who select or interpret tests for 
then organizations. There is no mechanism, 
however, to enforce compliance with the 
Standards on the part of the test developer or 
test user. The Standards, moreover, do not 
attempt to provide psychometric answers to 
policy or legal questions. They do not 
themselves set requhements, but serve to 
distribrrte best practices and procedrues. 

FRE 403 Prejitdice. The federal govenuneut 
reqirhes compliance with the 1999 Standards 
throirgli Title 34 Section 668.146 of the Code 
of Federal Regirlations, and the witness’s 
discrrssion of compliance mechanisms by other 
parties is irrelevant and confirses the issrres. 

Tire testimony omits reference to any relevant 
timeframe, and witness’s rrse of the term 
“Standards” withoirt referencing a particirlar 
edition or relevant timefr ame confirses the 
issrres. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not uitrodirced 
sirfficient evidence to show the witness has 
personal knowledge of this matter, particrrlarly 
for any time period prior to her employment 
with APA, or for the goals or intent of the 
Standards, which she did not arrthor. 

FRE 702 Umeliable Expert Opinion. The 
proffered testimony is an expert opinion by a 
witness who is not qrralifred as an expert by 
knowledge, skill, experience, training, or 
edircation. The testimony fruther will not help 
the trier of fact to rmderstand the evidence or 
to determine a fact m issrre; is not based on 
sufficient facts or data; is not the prodirct of 
reliable principles and methods; and is not 
based on the expert’s reliable application of 
reliable principles and methods to the facts of 
the case. 

FRE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of a 
docirment. 
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20. The Standards apply broadly to a wide 
range of standardized instimnents and 
procediues that sample an individuaTs 
behavior, including tests, assessments, 
inventories, scales, and other testing vehicles. 

The Standards apply equally to standardized 
multiple-choice tests, perfonnance assessments 
(including tests comprised of only open-ended 
essays), and hands-on assessments or 
simulations. The main exceptions are that the 
Standards do not apply to imstaudardized 
questionnaiies (e.g. , imstmctiued behavioral 
checklists or obseiwational foiins), teacher- 
made tests, and subjective decision processes 
(e.g., a teacher’s evaluation of students’ 
classroom participation over the coiuse of a 
semester). 

FRE 402 Relevance. The proffered testimony 
concerning the types of testing the standards 
apply to does not have any tendency to make a 
fact of consequence in this litigation more or 
less probable than it would be without the 
evidence. 

FRE 403 Prejudice. The testimony omits any 
relevant timeframe and does not specify which 
editions of the Standar ds are refeiied to, which 
confrises the issues. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering paify has not intioduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 702 Umeliable Expert Opinion. The 
proffered testimony on the application of the 
Standards is an expert opinion by a witness 
who is not qualified as an expert by 
knowledge, skill, experience, tiaining, or 
education. The testimony fiulher will not help 
the trier of fact to imderstand the evidence or 
to deteimine a fact in issue; is not based on 
sufficient facts or data; is not the product of 
reliable principles and methods; and is not 
based on the expert’s reliable application of 
reliable principles and methods to the facts of 
the case. 

2 1 . The Standards have been used to develop 
testing guidelines for such activities as college 
admissions, personnel selection, test 
translations, test user qualifications, and 
computer-based testing. The Standards also 
have been widely cited to address technical, 
professional, and operational noiins for all 
foims of assessments that are professionally 
developed and used in a variety of settings. Tlie 
Standards additionally provide a valuable public 
seiwice to state and federal govemmeuts as they 

FRE 402 Relevance. Tire proffered testimony 
concerning the use of the Standards does not 
have any tendency to make a fact of 
consequence in this litigation more or less 
probable than it would be without the 
evidence. 

FRE 403 Prejudice. The testimony omits any 
relevant timeframe, which confrises the issues. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
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voluntarily choose to use them. For instance, 
each testing company, when submitting 
proposals for testing administration, instead of 
relying on a patchwork of local, or even 
individual and proprietary, testing design and 
implementation criteria, may rely instead on the 
Sponsoiing Organizations’ Standards to afford 
the best guidance for testing and assessment 
practices. 

and the proffering paity has not intioduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 1002 Secondaiy Evidence. The proffered 
testimony is offered to prove the contents of 
documents. 

22. The Sponsoring Organizations do not keep 
any of the revenues generated from the sales of 
the Standards. Rather, the income from these 
sales is used by the Sponsoiing Organizations 
to offset then development and production costs 
and to generate frmds for subsequent revisions. 
This strategy allows the Sponsoring 
Organizations to develop up-to-date, high 
quality Standards that otheiwise would not be 
developed due to the time and effort that goes 
into producing them. 

FRE 403 Prejudice. The statement that the 
Plaintiffs do not “keep” any of the revenues, 
but use them for certain operating expenses, is 
incomplete and misleading, because Plaintiffs 
do keep the revenues but simply eaimark them 
for particular piuposes. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering paity has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 702 Umeliable Expert Opinion. The 
proffered testimony concerning the business 
model used for sale and development of the 
Standards is an expert opinion by a witness 
who is not qualified as an expert by 
knowledge, skill, experience, training, or 
education. The testimony fruther will not help 
the trier of fact to imderstand the evidence or 
to detennine a fact in issue; is not based on 
sufficient facts or data; is not the product of 
reliable principles and methods; and is not 
based on the expert’s reliable application of 
reliable principles and methods to the facts of 
the case. 

23. Without the sales revenue from prior 
Standaids versions (because - if Public 

Resoince succeeds in this litigation - this 
publication will be made freely available 
online), it is extremely imlikely that fritine 

FRE 403 Prejudice. The 2014 Standards are 
not at issue in this litigation, and Plaintiffs 
vohmtarily stopped selling the 1999 Standards, 
the only edition at issue. The witness’s 
statement is misleading because it suggests 
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updates to the Standards will be imdeilaken. 

This well-iufoiined opinion is made because 
NCME is too small an organization to 
financially support periodic updates of the 
Standards, AERA does not have the budget for 
it, and an insufficient number of 
psychometricians are members of APA for it to 
justify the ongoing expenditiues. Charging 
extra membership fees to frmd ongoing updates 
to the Standards would never happen, because 
the governing bodies of AERA, APA and 

NCME would not vote for it. If these 

Sponsoring Organizations ceased updating the 
Standards, it is imlikely that other organizations 
would step in and continue the effort. 

Moreover, there are no other organizations with 
the expertise in their memberships to populate 
such a committee or task force. 

that Public Resoince’s actions risk depriving 
Plaintiffs of income fr om the sale of the 2014 
Standards. The witness’s statement is also 
speculative and risks conflising the issues in 
this case. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 702 Umeliable Expert Opinion. The 
proffered testimony concerning the business 
model used for sale and development of the 
Standards is an expert opinion by a witness 
who is not qualified as an expert by 
knowledge, skill, experience, training, or 
edircation. The testimony fiuther will not help 
the trier of fact to imderstand the evidence or 
to determine a fact in issire; is not based on 
sufficient facts or data; is not the prodirct of 
reliable principles and methods; and is not 
based on the expert’s reliable application of 
reliable principles and methods to the facts of 
the case. 

24. There simply is no way for Plaintiffs to 
calculate with any degr ee of certainty the 
niuuber of imiversity/college professors, 
students, testing companies and others who 
would have piuchased Plaintiffs’ Standards but 
for then wholesale posting on Defendant’s 
httDs://law.resoince.ore website and the Internet 
Archive http;//archive.ors website. 

FRE 702 Umeliable Expert Opinion. The 
proffered testimony conceriiirrg the economic 
srrbstitirtion effect of Pirblic Resoirrce’s posting 
of the 1999 Standards is an expert opinion by a 
witness who is not qrralified as an expert by 
knowledge, skill, experience, training, or 
edrrcation. The testimony fiuther will not help 
the trier of fact to rmderstand the evidence or 
to determine a fact in issue; is not based on 
sirfficient facts or data; is not the prodrrct of 
reliable principles and methods; and is not 
based on the expert’s reliable application of 
reliable principles and methods to the facts of 
the case. 

25. In Fiscal Year (“FY”) 201 1 to FY 2012, as 

FRE 403 Prejudice. The probative vahre of the 
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compared to FY 2011, the Sponsoring 
Organizations experienced a 34% drop in sales 
of the 1999 Standards. In FY 2013, sales of the 
1999 Standards remained at then low level from 
the prior fiscal year' (See F. Levine Declaration, 

T[ 18, Exh. OOO). For a publication with the 
longevity of the 1999 Standards, one otheiwise 
would expect to see a gradual decline in sales 
year-over-yeai'; not the precipitous drop in sales 
experienced by the 1999 Standards in 2012 and 
2013 - even considering that updated Standards 
were published in 2014. It is also clear that this 
chop did not occm' due to the expected 
publication of the 2014 Standards, because they 
were actually due to be published more than a 
year earlier. Tims, one would have expected 
such a (hop to occin perhaps in 2010 or 201 1 . 

proffered testimony on sales is substantially 
outweighed by a danger of imfair prejudice, 
confusing the issues, and misleading the 
factfinder, because the witness’s conclusions 
are both contrary to fact and mischaracterize 
the evidence. What the witness presents as 
sales data is actually gross revenue data. The 
witness fails to provide context as to the 
general decline in both sales and revenues for 
the 1999 Standards that began prior to Public 
Resoince’s posting of the 1999 Standards. 


FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introdrrced 
srtfficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 702 Umeliable Expert Opinion. The 
proffered testimony conceriring the sales of the 
1999 Starrdards and the economic srrbstitrrtiorr 
effect of Prtblic Resornce’s posting of the 1999 
Starrdards is an expert opiniorr by a witness 
who is not qitalifred as an expert by 
knowledge, skill, experience, training, or 
edircation. The testimony fruther will not help 
the trier of fact to rmderstand the evidence or 
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to determine a fact in issue; is not based on 
sufficient facts or data; is not the product of 
reliable principles and methods; and is not 
based on the expert’s reliable application of 
reliable principles and methods to the facts of 
the case. 

26. Past hami from Public Resource’s 
infr inging activities includes misuse of 

Plaintiffs’ intellectual property without 
pemiission, lost sales that carmot be totally 
accoimted for - due to potentially infinite 

Internet distribution, especially by 
psychometrics students, and lack of frmding that 
otherwise would have been available for the 
update of the Sponsoring Organizations’ 
Standards from the 1999 to the 2014 versions. 

FRE 403 Prejudice. The witness’s statement 
regarding “potentially infinite Internet 
distribution” has no factual basis and invites 
speculation through unrealistic and bombastic 
terminology. The probative value of the 
proffered testimony is substantially 
outweighed by a danger of imfair prejudice, 
confusing the issues, and misleading the 
factfinder. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 702 Umeliable Expert Opinion. The 
proffered testimony concerning harm 
attributed to Public Resomce is an expert 
opinion by a witness who is not qualified as an 
expert by knowledge, skill, experience, 
training, or education. The testimony fruther 
will not help the trier of fact to imderstand the 
evidence or to determine a fact in issue; is not 
based on sufficient facts or data; is not the 
product of reliable principles and methods; and 
is not based on the expert’s reliable application 
of reliable principles and methods to the facts 
of the case. 

27. Should Public Resoiuce’s infringement be 
allowed to continue, the harm to the Sponsoring 
Organizations, and public at large who rely on 
the preparation and administr ation of valid, fan 
and reliable tests, includes: (i) imcoutrolled 
publication of the 1999 Standards without any 

FRE 403 Prejudice. The 2014 Standards are 
not at issue in this litigation, and Plaintiffs 
vohuitarily stopped selling the 1999 Standards, 
the only editiorr at issire. The witness’s 
statement is misleading becairse it sirggests 
that Pitblic Resoiuce’s actions risk depriving 
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notice that those guidelines have been replaced 
by the 2014 Standards; (ii) fixtiue imquantifiable 
loss of revenue fiom sales of authorized copies 
of the 1999 Standards (with proper notice that 
they are no longer the cunent version) and the 
2014 Standards; and (iii) lack of flmdiug for 
fiitiue revisions of the 2014 Standards and 
beyond. 


Plaintiffs of income from the sale of the 2014 
Standards. The witness’s statement is also 
speculative and risks confiising the issues in 
this case. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 702 Umeliable Expert Opinion. The 
proffered testimony corrceriring harm 
attributed to Pirblic Resomce is an expert 
opinion by a witness who is not qrralified as an 
expert by knowledge, skill, experience, 
training, or education. Tire testimony firrther 
will not help the trier of fact to imderstand the 
evidence or to determiue a fact in issire; is not 
based on sufficient facts or data; is not the 
product of reliable principles and methods; and 
is not based on the expert’s reliable application 
of reliable principles and methods to the facts 
of the case. 
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28. The hann caused to the public by 
publication of out-of-date Standards (not 
labeled as such) will be significant, because the 
testing and assessment fields are constantly 
changing, given updates in testmg technology 
and ever-evolving collective thought on the 
validity, reliability and fairness of tests. 

Members of the public who would be harmed 
by discontinued updates of the Standards 
include psychometrics professors, students and 
professionals, as well as test developers, 
administrators and takers. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not intr odirced 
sirfficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 702 Umeliable Expert Opinion. The 
proffered testimony concerning harm 
attribrrted to Pirblic Resoiuce is an expert 
opmion by a witness who is not qiralified as an 
expert by knowledge, skill, experience, 
training, or edircation. Tire testimony fiuther 
will not help the trier of fact to imderstarrd the 
evidence or to determine a fact in issrre; is not 
based on sirfficient facts or data; is not the 
product of reliable principles and methods; and 
is not based on the expert’s reliable application 
of reliable principles and methods to the facts 
of the case. 


V. OBJECTIONS TO THE DECLARATION OF PLAINTIFFS’ LEAD COUNSEL 

JONATHAN HUDIS IN SUPPORT OF PLAINTIFFS’ MOTION FOR SUMMARY 
JUDGMENT AND ENTRY OF A PERMANENT INJUNCTION 


Declaration of Jonathan Hudis In Support of 
Plaintiffs’ Motion for Summary Judgment 

Defendant-Counterclaimant 

Public Resource’s Objections 

1 . 1 am a partner with Quarles & Brady LLP, 
lead coimsel to Plaintiffs, AMERICAN 
EDUCATIONAL RESEARCH 

ASSOCIATION, INC. (“AERA”), 

AMERICAN PSYCHOLOGICAL 
ASSOCIATION, INC. (“APA”) and 

NATIONAL COUNCIL ON 

MEASUREMENT IN EDUCATION, INC. 
(“NCME”) (collectively, “Plaintiffs”) in the 
captioned action. I submit this Declaration in 
support of Plaintiffs’ motion for sirmmary 
judgment and entry of a permanent injimction 
against Defendant, Public.Resource.Org, Inc. 

No Objection. 
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2. Accompanying tliis Declaration as Exhibit A 
is a true copy of the tr anscript from the 
deposition of Carl Malamud (“Malamud”), 
taken in his personal capacity and as the 
Fed.R.Civ.P. 30(b)(6) representative of 
Defendant (see transcript, pp. 14-22), on 

May 12, 2015 (the “Malamud/Rrblic Resomce 
Deposition”). 

Pirblic Resomce hereby preserves the 
objections that its coimsel made at the tirue of 
the deposition. 

3. Accompanying tliis Declaration as Exhibit B 
is a true copy of the Articles of Incorporation of 
Pitblic Resomce, fried with the California 
Secretary of State on April 13, 2007, marked as 
Exhibit 16 dming the Malamitd/Rrblic 

Resource Deposition. 

No Objection. 

4. Accompanying this Declaration as Exhibit C 
is a true copy of the Bylaws of Pirblic Resomce, 
having a “last revised” date of April 18, 2007 
(see p. 23), marked as Exliibit 17 dming the 
Malamud/Pirblic Resomce Deposition. 

No Objection. 

5. Accompanying this Declaration as Exhibit D 
are true copies of the home page and “Aboirt” 
page from Pirblic Resomce’s website, 
httDs://t)ublic.resomce.ore, marked as 

Exhibits 19 and 20 dming the Malamud/Pirblic 
Resomce Deposition. 

ERE 403 Prejudice. The characterization of 
Exhibit D is misleading to the extent that it 
does not specify the date when it was created. 
According to the statement by Plaintiffs’ 
coimsel, this exliibit reflects the Public 

Resomce home page and “About” page in 

March 2014. ICE Ex. 7 (Malamud Dep. 
110:25-112:02). 

6. Accompanying tliis Declaration as Exhibit E 
is a true copy of a representative list of projects 
Malamud/Pirblic Resomce has been involved in 
and publications he has written as author or co- 

ERE 402 Relevance. Tlie proffered exhibit 
does not have any tendency to make a fact of 
consequence more or less probable than it 
would be without the evidence. 

author, ruarked as Exhibit 15 dming the 
Malamud/Pirblic Resource Deposition. 

ERE 602 Lack of Personal Knowledge. The 
proffered exhibit is not based on the witness’s 
personal knowledge of the matter and the 
proffering parly has not introduced sufficient 
evidence to show the witness has personal 
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knowledge of this matter. 

ERE 802 Hearsay. The proffered exhibit is an 
out-of-coiul statement that is offered to prove 
the tnith of the matter asserted. 

ERE 901 Lack of Authentication. The witness 
has not testified that the proffered docimient is 
what the witness pmports it to be. The 
proffering party cannot show that it could 
present a witness with personal knowledge of 
the proffered document necessaiy to 
authenticate it at tiial. 

ERE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of a 
document. 

ERE 1006 Improper Summaiy. The proffered 
testimony or document is a summaiy, chart, or 
calculation offered to prove the content of 
volumiuous wr itings, recordings, or 
photographs that carmot be conveniently 
examined in comt. The proffering party has 
not made originals or duplicates of the 
voluminous docimients available for 
examhiation or copying at a reasonable time or 
place — dming the discovery period of this 
action. 

7. Accompanying this Declaration as Exhibit F 
is a tine copy of a dociunented Kickstaiter 
crowd-fimding campaign laimched by Public 
Resoiuce in 2013, to obtain outside financial 
support for copying and posting thiid pai1y 
standards and codes to the 
httDs://miblic.resoiuce.ore website. These 
captiued Kickstarter web pages were marked as 
Exhibit 27 dining the Malamud/Public 

Resource Deposition. 

ERE 402 Relevance. The proffered testimony 
and exhibit does not relate to the posting of the 
1999 Standards at issue in this litigation, and 
does not have any tendency to make a fact of 
consequence more or less probable than it 
would be without the evidence. 

ERE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

ERE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of a 
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document. 

8. Accompanying this Declaration as Exhibit G 
is a tine copy of the “Geneva” chapter from 
Malamnd’s book entitled Exploring the 

Internet: A Technical Travelogue, published in 
1993, marked as Exhibit 22 dming the 
Malamud/Public Resomce Deposition. 

ERE 402 Relevance. Tlie proffered exhibit, a 
chapter fr om a book published in 1993, does 
not relate to the posting of the 1999 Standards 
at issue in this litigation or incoiporation by 
reference, and does not have any tendency to 
make a fact of consequence more or less 
probable than it would be without the 
evidence. 

ERE 403 Prejudice. The proffered exhibit is 
just one chapter (pages 124-133) of a book 
that was published in 1993. It is presented 
without the accompanying text that would 
provide context necessary to imderstand the 
terms and issues discussed therein. The 
probative value of the proffered exhibit is 
substantially outweighed by a danger of imfair 
prejudice, conftising the issues, misleading the 
factfinder, and wastmg time. 

ERE 602 Lack of Personal Knowledge. The 
proffered testimony and exhibit is not based on 
the witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

9. Accompanying tliis Declaration as Exhibit H 
is a tine copy of Malamud, C., Liberating 
America 's Secret. For-Pav Laws, boineboing, 
March 19, 2012, marked as Exhibit 25 dining 
the Malamud/Pnblic Resomce Deposition. 

No Objection. 

10. Accompanying this Declaration as Exhibit I 
is a tine copy of Garfield. B., Making Laws 

More Public Transcript - On The Media, 
intei'view of Carl Malamud, The Media. 

April 13, 2012, marked as Exhibit 24 dining the 
Malamud/Public Resomce Deposition. 

ERE 403 Prejudice. Mr’. Malamud stated at 
deposition that he did not recognize the 
docirment depicted in this exhibit. ICE Ex. 7 
(Malamud Dep. 173:1 1-174:10). It is not clear 
who made this tr anscript or whether it 
accurately transcribes an interview in wliich 

Mr’. Malamud was a participant. The probative 
value of the proffered testimony is 
substantially outweighed by a danger of unfair’ 
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prejudice, confiising the issues, and misleading 
the factfinder. 

FRE 602 Lack of Personal Knowledge. 

Mr. Malamud stated at deposition that he did 
not recognize the document depicted in this 
exhibit. ICE Ex. 7 (Malamud Dep. 173; 1 1— 
174:10). It is not clear who made this transcript 
or whether it acciuately transcribes an 
mterview in which Mi’. Malamud was a 
participant. The proffered testimony is not 
based on the witness’s personal knowledge of 
the matter and the proffering pai’ty has not 
mtroduced sufficient evidence to show the 
witness has personal knowledge of this matter. 

FRE 802 Hearsay. The exhibit is a transcript 
produced by an unknown thud party, 
purporting to be a transcript of an iutei’view hr 
which Mr. Malamud was a participant, also 
mcluding statements by a person named Bob 
Garfield. It is rmknown if the transcription is 
accmate. The proffered testimony is an out-of- 
coiut statement that is offered to prove the 
truth of the matter asserted. 

FRE 901 Lack of Authentication. 

Mr. Malamud stated at deposition that he did 
not recognize the document depicted in this 
exhibit. ICE Ex. 7 (Malamud Dep. 173:11- 
174:10). It is not clear who made this transcript 
or whether it acciuately transcribes an 
interview in which Mi’. Malamud was a 
participant. The proffering party caimot show 
that it could present a witness with personal 
knowledge of the proffered document 
necessary to authenticate it at trial. 

1 1 . Accompanying this Declaration as Exhibit J 
to this Declaration is a tine and accmate copy of 
“Pubhc Safety Codes hicoiporated by Law,” 
appearing on Defendant’s website at 
httD;//law.resoiuce.ore/Dub/us/code/safetv.htnil 

No Objection. 

(last visited December 17, 2015). 


56 


Case l:14-cv-00857-TSC Document 69-4 Filed 01/21/16 Page 63 of 108 


Declaration of Jonathan Hudis In Support of 
Plaintiffs’ Motion for Summary Judgment 

Defendant-Counterclaimant 

Public Resource’s Objections 

12. Accompanying tliis Declaration as 

Exhibit K to this Declaration is a trae and 
accmate copy of “Public Safety Standaids 

United States (Federal Govemmeut),” 
appearing on Defendant’s website at 
httD://law.resomce.ora/mib/us/cfr/manifest.us. 

html (last visited December 17, 2015). 

No Objection. 

13. Accompanying this Declaration as Exhibit L 
to this Declaration is a tme and accmate copy of 
the Register of Copyrights’ online abstract for 
U.S. Copyright Registration No. TX 5-920-538, 
for the work “Safety standard for belt manlifts; 
ASME A90. 1-2003.” 

ERE 402 Relevance. Tire proffered exhibit 
does not relate to the 1999 Standaids at issue 
in this litigation and does not have any 
tendency to make a fact of consequence more 
or less probable than it would be without the 
evidence. 

ERE 403 Prejudice. This is an online abstract, 
not an actual copyright registration. The 
Plaintiffs have no knowledge as to whether the 
American Society of Mechanical Engineers 
actually owns the rights to the work cited in 
this online copyright registration abstract, and 
Plaintiffs enoneously present it as proof of 
ownership and infringement. The probative 
value of the proffered exhibit is substantially 
outweighed by a danger of mifair prejudice, 
confrising the issues, misleading the factfruder, 
and wasting time. 

ERE 802 Hearsay. This is an online abstract, 
not an actual copyright registr ation. The 
proffered testimony is an out-of-court 
statement that is offered to prove the truth of 
the matter asserted. 

ERE 901 Lack of Authentication. The witness 
has not testified that the proffered document is 
what the witness pmpoits it to be. The 
proffering party caimot show that it could 
present a witness with personal knowledge of 
the proffered document necessary to 
authenticate it at trial. 

14. Accompanying this Declaration as 

Exhibit M to this Declaration is a true and 

ERE 402 Relevance. Tire proffered exhibit 
does not relate to the 1999 Starrdards at issue 
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acciuate copy of the Register of Copyrights’ 
online abstract for U.S. Copyright Registration 
No. TX 5-181-138, for the work “Grridelines for 
the definition of onshore gas gatherirrg lines.” 

m this litigation and does not have any 
tendency to make a fact of conseqrrence more 
or less probable than it worrld be withorrt the 
evidence. 

ERE 403 Prejitdice. This is an online abstract, 
not an actrral copyright registration. Tire 
Plaintiffs have no knowledge as to whether the 
American Petrolerrm Institrrte achrally owns 
the rights to the work cited in this online 
copyright registration abstract, and Plaintiffs 
en oneoirsly present it as proof of ownership 
and infi'ingemerrt. The probative vahre of the 
proffered exhibit is srrbstantially orrtweighed 
by a danger of rmfair' prejrrdice, confirsing the 
issrres, misleading the factfinder, and wasting 
time. 

ERE 802 Hearsay. This is an online abshact, 
not an actrral copyright registration. Tire 
proffered testimony is an orrt-of-corrrt 
statement that is offered to prove the tnrth of 
the matter asserted. 

ERE 901 Lack of Arrthentication. The witness 
has not testified that the proffered docrrmerrt is 
what the witness pruports it to be. The 
proffering party carmot show that it corrld 
present a witness with personal knowledge of 
the proffered docrrment necessary to 
airthenticate it at trial. 

15. Accompanying this Declaration as 

Exhibit N to this Declaration is a tnre and 
accruate copy of the Register of Copyrights’ 
online abstract for U.S. Copyright Registration 
No. TX 427-109, for the work “Official 
methods of analysis of the Association of 

Official Analytical Chemists.” 

ERE 402 Relevance. The proffered exhibit 
does not relate to the 1999 Starrdards at issire 
in this litigation and does not have any 
tendency to make a fact of conseqrrence more 
or less probable than it worrld be withorrt the 
evidence. 

ERE 403 Prejrrdice. This is an online abstract, 
not an actrral copyright registration. Tire 
Plaintiffs have no knowledge as to whether the 
Association of Official Analytical Chemists 
achrally owns the rights to the work cited in 
this online copyright registration abstract, and 
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Plaintiffs erroneously preserrt it as proof of 
ownership and iufiingement. The probative 
vahte of the proffered exhibit is sirbstantially 
oirtweighed by a danger of imfair prejitdice, 
confirsing the issrtes, misleading the factfinder, 
and wasting time. 

FRE 802 Hearsay. This is an online abstract, 
not an actiral copyright registration. Tire 
proffered testimony is an orrt-of-coiut 
statement that is offered to prove the trrrth of 
the matter asserted. 

FRE 901 Lack of Airthentication. The witness 
has not testified that the proffered docrrmerrt is 
what the witness pmports it to be. The 
proffering party carmot show that it coitld 
preserrt a witrress with persorral knowledge of 
the proffered docirmeut necessary to 
airtheuticate it at trial. 

16. Accompanying this Declaration as 

Exhibit O to this Declaration is a tiTie and 
accluate copy of the Register of Copyrights’ 
online abstract for U.S. Copyright Registration 
No. TX 1-142-464, for the work “Classification 
in mental retardation.” 

FRE 402 Relevarrce. Tire proffered exhibit 
does not relate to the 1999 Standards at issite 
irr this litigation and does not have any 
tendency to make a fact of conseqireuce more 
or less probable than it would be withoirt the 
evidence. 

FRE 403 Prejitdice. This is an online abstract, 
not an actual copyright registration. Tire 
Plaintiffs have no knowledge as to whether the 
American Association on Mental Deficiency 
actirally owns the rights to the work cited in 
tliis online copyright registration abstract, and 
Plaintiffs enoueously present it as proof of 
ownership and infiingement. The probative 
value of the proffered exhibit is substantially 
outweighed by a danger of imfair prejudice, 
confirsing the issues, misleading the factfinder, 
and wasting time. 

FRE 802 Hearsay. This is an online abstract, 
not an actual copyright registration. Tire 
proffered testimony is an out-of-court 
statement that is offered to prove the trirth of 
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the matter asserted. 

ERE 901 Lack of Airthentication. The witness 
has not testified that the proffered docirment is 
what the witness pmports it to be. The 
proffering party carmot show that it coirld 
present a witrress with personal knowledge of 
the proffered docirment necessary to 
authenticate it at hial. 

17. Accompanying this Declaration as Exhibit P 
to this Declaration is a tiaie and accmate copy of 
the Register of Copyrights’ online abstract for 
U.S. Copyright Registratiorr No. TX 2-953-680, 
for the work “Glazing rnaniral.” 

ERE 402 Relevance. The proffered exhibit 
does not relate to the 1999 Standards at issire 
in this litigation and does not have any 
tendency to make a fact of conseqirence more 
or less probable than it woirld be without the 
evidence. 

ERE 403 Prejudice. This is an online abstract, 
not an actual copyright registration. Tire 
Plaintiffs have no knowledge as to whether the 
Flat Glass Marketing Association actually 
owns the rights to the work cited in this online 
copyright registration abstract, and Plaintiffs 
en oneously present it as proof of ownership 
and infiingement. The probative value of the 
proffered exhibit is substantially outweighed 
by a danger of unfah prejudice, conflising the 
issires, misleading the factfinder, and wasting 
time. 

ERE 802 Hearsay. This is an online abshact, 
not an actual copyright registration. The 
proffered testunony is an out-of-court 
statement that is offered to prove the tnrth of 
the matter asserted. 

ERE 901 Lack of Authentication. The witness 
has not testified that the proffered document is 
what the witness pmports it to be. The 
proffering party carmot show that it could 
present a witness with personal knowledge of 
the proffered document necessary to 
authenticate it at trial. 

18. Accompanying this Declaration as 

ERE 402 Relevance. Tire proffered exhibit 
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Exhibit Q to this Declaration is a tiaie and 
acciuate copy of the Register of Copyrights’ 
online abstract for U.S. Copyright Registration 
No. TX 6-062-476, for the work “Mobile and 
locomotive cranes : ASME B30. 5-2004.” 

does not relate to the 1999 Starrdards at issire 
irr this litigation and does not have any 
tendency to make a fact of conseqirence more 
or less probable than it woirld be withoirt the 
evidence. 

ERE 403 Prejudice. This is an online abstract, 
not an actiral copyright registration. The 
Plaintiffs have no knowledge as to whether the 
Amer ican Society of Mechanical Engineers 
actrrally owns the rights to the work cited in 
this online copyr ight registration abstract, and 
Plaintiffs en oneoirsly present it as proof of 
ownership and infiingernerrt. The probative 
vahre of the proffered exhibit is sirbstantially 
oirtweighed by a danger of imfair prejirdice, 
confltsing the issrres, misleading the factfinder, 
and wasting time. 

ERE 802 Hearsay. This is an online abstract, 
not an actrral copyright registration. The 
proffered testimony is an orrt-of-comt 
statement that is offered to prove the tnrth of 
the matter asserted. 

ERE 901 Lack of Arrtherrticatiorr. The witness 
has not testified that the proffered docrrment is 
what the witness piuporfs it to be. The 
proffering party cannot show that it coirld 
present a witness with personal knowledge of 
the proffered docrrment necessary to 
airtherrticate it at trial. 

19. Accompanying this Declaration as 

Exhibit R to this Declaration is a tnre and 
accruate copy of the Register of Copyrights’ 
online abstract for U.S. Copyright Registration 
No. TX 5-434-639, for the work “Drinking 
water system comporrents: health effects: 
American national standard/NSF international 
standard for drirrking water additives: 

ANSI/INSF 61-2001.” 

ERE 402 Relevarrce. Tire proffered exhibit 
does not relate to the 1999 Starrdards at issire 
in this litigation and does not have any 
tendency to make a fact of conseqirence more 
or less probable than it would be without the 
evidence. 

ERE 403 Prejudice. This is an online abstract, 
not an actiral copyright registration. The 
Plaintiffs have no knowledge as to whether the 
National Sanitation Foimdation actrrally owns 
the rights to the work cited in this online 
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copyiight registiatiou abstract, and Plaintiffs 
eiToneously present it as proof of ownership 
and infiingement. The probative value of the 
proffered exhibit is substantially outweighed 
by a danger of irnfah prejudice, confiising the 
issues, misleading the factfinder, and wasting 
time. 

FRE 802 Hearsay. This is an online abstiact, 
not an actual copyiight registration. Tlie 
proffered testimony is an out-of-court 
statement that is offered to prove the tnith of 
the matter asserted. 

FRE 901 Lack of Authentication. The witness 
has not testified that the proffered document is 
what the witness pmports it to be. The 
proffering paily cannot show that it could 
present a witness with personal knowledge of 
the proffered document necessary to 
authenticate it at trial. 

20. Accompanying this Declaration as Exhibit S 
to this Declaration is a tme and acciuate copy of 
the Register of Copyiights’ online abstiact for 
U.S. Copyright Registration No. TX 5-902-199, 
for the work “Minimiun design loads for 
buildmgs and other stmctines.” 

FRE 402 Relevance. The proffered exhibit 
does not relate to the 1999 Standards at issue 
in this litigation and does not have any 
tendency to make a fact of consequence more 
or less probable than it would be without the 
evidence. 

FRE 403 Prejudice. This is an online abstract, 
not an actual copyiight registration. Tlie 
Plaintiffs have no knowledge as to whether the 
American Society of Civil Engineers actually 
owns the rights to the work cited in this online 
copyiight registration abstract, and Plaintiffs 
eiToneously present it as proof of ownership 
and infiingement. The probative value of the 
proffered exhibit is substantially outweighed 
by a danger of imfair prejudice, confusing the 
issues, misleading the factfinder, and wasting 
time. 

FRE 802 Hearsay. This is an online abstiact, 
not an actual copyiight registration. The 
proffered testimony is an out-of-court 
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statement that is offered to prove the huth of 
the matter asserted. 


FRE 901 Lack of Authentication. The witness 
has not testified that the proffered document is 
what the witness piupoits it to be. The 
proffering paity cannot show that it could 
present a witness with personal knowledge of 
the proffered document necessaiy to 
authenticate it at trial. 

2 1 . Accompanying tliis Declaration as Exhibit T 
is a tnie copy of DEFENDANT- 
COUNTERCLAIMANT 
PUBLIC.RESOURCE.ORG, INC.’S 

AMENDED RESPONSES TO 
PLAINTIFFSCOUNTERDEFEND ANTS’ 

FIRST SET OF INTERROGATORIES 
(NOS 1-8), marked as Exhibit 29 dining the 
Malamud/Public Resoince Deposition. 

Public Resoince hereby preseiwes the 
objections made in its iutenogatory responses. 

22. Accompanying this Declaration as 

Exhibit U is a tine copy of Public Resomce’s 
receipt, dated May 17, 2015, for its pinchase of 
PlamtifTs Standards for Educational and 
Psychological Testing (1999 ed.), marked as 
Exhibit 30 diuuig the Malamud/Public 

Resoince Deposition. 

No Objection. 

23. Accompanying this Declaration as 

Exhibit V is a hue copy of Plaintiffs’ Standards 
for Educational and Psychological Testmg 
(1999 ed.), marked as Exhibit 31 during the 
Malamud/Public Resoince Deposition. 

No Objection. 

24. Accompanying this Declaration as 

Exhibit W is a hue copy of a letter and Freedom 
of lufomiation Action (“FOIA”) request dated 
July 14, 2009 from Public Resoince to the 
General Coimsel of the National Ai chives, 
requesting a copy of, mter alia. Plaintiffs’ 1999 
Standards for free or at reduced cost pmsuaut to 
a “fee waiver,” marked as Exhibit 32 dining the 
Malamud/Public Resomce Deposition. 

No Objection. 
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25. Accompanying tliis Declaration as 

Exhibit X is a tine copy of letter dated 

August 3, 2009 from the National Ar chives to 
Public Resoiuce, marked as Exhibit 33 dining 
the Malamud/Public Resoiuce Deposition, in 
wliich the National Ar chives denies Public 
Resomce’s FOIA request of Exhibit W above. 

No Objection. 

26. Accompanying this Declaration as 

Exhibit Y is a tine copy of the cover sheet, or 
self-made “Certificate,” that Malamud 
appended to the front of the PDF file 
“aera.standards.l999.pdf, “ Defendant’s 
imauthorized digital copy of Plaintiffs’ 

Standards for Educational and Psychological 
Testing (1999 ed.), marked as part of Exhibit 34 
dining the Malamud/Public Resoiuce 

Deposition. 

No Objection. 

27. Accompanying this Declaration as Exhibit Z 
is a tine copy of the transcript fr om the 
deposition of James R. Finchteiiuan 
(“Finchteinian”), Defeticiorit ’s Expert, taken on 
September 8, 2015 (the “Finchteinian 
Deposition”). 

Public Resoiuce hereby preserves the 
objections that its coimsel made at the time of 
the deposition. 

28. Accompanying this Declaration as 

Exhibit AA is a tme copy of the Finchteinian 
Expert Report, marked as part of Exhibit 64 
during the Fmchterman Deposition. 

No Objection. 

29. Accompanying this Declaration as 

Exhibit BB is a tine copy of portions of the 
transcript from the deposition of Christopher 
Butler (“Butler”), Office Manager of the 

Internet Archive (see transcript at pp. 5, 7-8 and 
28-30), taken on December 2, 2014 (the 
“Butler/hitemet Archive Deposition”), 

Public Resoiuce hereby presei'ves the 
objections that its coimsel made at the time of 
the deposition. 


64 


Case l:14-cv-00857-TSC Document 69-4 Filed 01/21/16 Page 71 of 108 


Declaration of Jonathan Hudis In Support of 
Plaintiffs’ Motion for Summary' Judgment 

Defendant-Counterclaimant 

Public Resource’s Objections 

30. Accompanying this Declaration as 

Exhibit CC is a tnie copy of a Declaration of 
Internet Archive (C. Butler) and Stipulation of 
the Parties (the “Birtler/Interiiet Archive 
Declaration”) signed by Birtler on Janirary 20, 
2015, sirbseqireut to and as a sirpplemeutation 
of the Birtler/Intemet Archive Deposition. 

No Objection. 

3 1 . Accompanying this Declaration as 

Exhibit DD is a trite copy of Internet Archive’s 
Terms of Use dated March 10, 2001, marked as 
Exhibit 5 dining the Butler/Intemet Archive 
Deposition. 

FRE 402 Relevance. Tlie Internet Archive’s 
Terms of Use is not related to any issue in this 
litigation and does not have any tendency to 
make a fact of consequence more or less 
probable than it would be without the 
evidence. 

32. Accompanying this Declaration as 

Exhibit EE is a true copy of Interuet Archive’s 
Item History for gov. law. aera. standards 1999, 
marked as Exhibit 7 dining the Butler/Interuet 
Archive Deposition. 

No Objection. 

33. Accompanying tliis Declaration as 

Exhibit FF is a true copy of Internet Archive’s 
Logs petlaiuuig to the Item History for 
gov.law.aera.standards.1999, marked as 

Exhibit 8 dining the Butler/Inteinet Archive 
Deposition. 

No Objection. 

34. Accompanying tliis Declaration collectively 
as Exhibit GG are a [x/c] true copies of screen 
captines of Plamtiffs’ 1999 Standards in the 
form that they were uploaded by Public 

Resoince to the Internet Archive website, 
marked as Exhibit 6 dining the Butler/Internet 
Archive Deposition. 

FRE 403 Prejudice. The description of this 
document is misleading and risks confiisirig 
the issues because it is erroneous. At 
deposition, the Rule 30(b)(6) representative of 
the Internet Archive identified these as 
screenshots of a details page depicting in part 
select pages from the 1999 Standards. ICE Ex. 

61 (Butler Dep. 57:07-59:09). 

35. Accompanying tliis Declaration as 

Exhibit HH is a true copy of DEFENDANT 
PUBLIC.RESOURCE.ORG, INC.’S 
RESPONSES TO PLAINTIFFS’ FIRST 
REQUESTS FOR ADMISSIONS, SET ONE 
(NOS. 1-8). 

Public Resoiu'ce hereby preserves the 
objections that it made m its responses to 
Plaintiffs’ requests for admissions. 
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36. On December 15, 2014, Plaintiffs filed a 
motion to compel discovery of, iuter alia, 
documentation verifying when Public Resomce 
published or posted Plamtiffs’ 1999 Standards 
to one of Public Resource’s websites, as well 
docimieutatiou verifying the number of times 
Plaintiffs’ 1999 Standards were viewed on, 
accessed from or downloaded fr om one of 

Public Resomce ’s websites (i.e.. Public 
Resource’s Internet server logs). The parties’ 
motion papers pertaining to Plaintiffs’ 
discovery motion may [ 57 c] foimd on the 

Comt’s docket at Dkt. Nos. 27, 29 and 30. Five 
months later, and withoirt explanation, the 

Coiut (Robinson, M-J) denied these parts of 
Plaintiffs’ discovery motiorr (Comt Order, 

May 20, 2015, Dkt. No. 49). 

ERE 402 Relevance. The proffered testunony 
does not have any tendency to make a fact of 
consequence more or less probable than it 
would be without the evidence. 

ERE 403 Prejudice. Plaintiffs’ motion was 
granted m part and denied in par1 after a frill 
briefing and opportimity to argue before the 
Comt. Plaintiffs had an opportunity to appeal 
the rilling and did not do so, and should not 
now attempt to cast doubt on the Comt’s nilmg 
and sow speculation. The probative value of 
the proffered testunony is substantially 
outweighed by a danger of imfair prejudice, 
confusing the issues, misleading the factfinder, 
and wasting time. 

37. Accompanying this Declaration as 

Exhibit II is a tme copy of luteriret Archive’s 
screen captme of its qirery resirlts to determine 
from its records the download coimt for the 
item with the identifier 
gov.law.aera.standards.1999, marked as 

Exhibit 1 1 dining the Butler/Intemet Archive 
Deposition. 

ERE 403 Prejudice. The Rule 30(b)(6) 
representative of the Internet Ar chive specified 
that “download” m this context refened to any 
access of the web address, not necessar ily a 
download onto a hard drive or other medium, 
and such access could be fr om either human 
beings or from Internet crawling robots 
(automated programs like webcrawlers), or 
uploaders, or internal visits from Internet 
Archive processes or staff. ICE Ex. 61 (Butler 
Dep. 126:02-126:21). Tire probative value of 
the proffered testunony is substantially 
outweighed by a danger of imfair prejudice, 
coufiising the issues, and misleading the 
factfinder. 

38. Accompanying this Declaration as 

Exhibit JJ is a hare copy of an e-mail dated 
December 16, 2013 from Mr. JohnNeikirk, 
Duector of Pirblications of Plaintiff AERA, to 
Carl Malamud, requesting removal of Plaintiffs’ 
1999 Standards from Public Resomce ’s 
httos://law.resomce.or 2 website, marked as 
Exhibit 39 dming the Malamud/Public 

Resomce Deposition. 

No Objection. 
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39. Accompanying tliis Declaiation as 

Exhibit KK is a tme copy of a letter dated 
December 19, 2013 from Carl Malamnd (on 
Public Resoiuce stationery) refrisiug to remove 
Plaintiffs’ 1999 Standards from Public 

Resource’s httv)s;//law.resource.ora website, 
marked as Exhibit 40 dining the 

Malamud/Public Resoiuce Deposition. 

No Objection. 

40. Accompanying tliis Declaration as 

Exhibit LL is a hue copy of an e-mail dated 

Time 10, 2014 from the imdersigned to Carl 
Malamnd regarding the initiation of this 
lawsuit, marked as Exhibit 42 dining the 
Malamud/Public Resoiuce Deposition. 

No Objection. 

41. Accompanying tliis Declaration as 

Exhibit MM is a tme copy of a memorandum 
on Riblic Resoiuce letterhead, signed by Cail 
Malamnd on Jiuie 12, 2014, imdeitakiug to 
remove Plaintiffs’ 1999 Standards from Public 
Resource’s httDs://law.resomce.or 2 website and 
from the Internet Aichive httnsV/archive.ora 
website pending the outcome of this litigation, 
marked as Exhibit 43 dining the 

Malamud/Public Resoiuce Deposition. 

No Objection. 
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Declaration of Felice J. Levine In Support of 
Plaintiffs’ Motion for Summary Judgment 

Defendant-Counterclaimant 

Public Resource’s Objections 

1 . 1 am the Executive Diiector of the American 
Educational Research Association, Inc. 
(“AERA”) I have been employed by the AERA 
since May 2002. 1 submit this Declaration in 
support of the motion of the AERA, the 
American. Psychological Association, Inc. 
(“APA”), and the National Comicil on 
Measmement in Education, Inc. (“NCME”) 
(collectively, “Plaintiffs” or “Sponsoring 
Organizations”) for summaiy judgment and the 
entiy of a pemianent injimction. 

No Objection. 

2. As set forth in the AERA Bylaws, the 
Executive Duector is the chief executive officer 
of the Association. In that capacity, I am 
responsible for all programmatic, financial, 
administrative, staffing, and managerial 
responsibilities of the AERA. I also advise on 
and implement the policies that guide oin 
organization. 

No Objection. 

3. As publisher, the AERA has provided general 
oversight since November 1999 for the 
production, printing, sales, and marketing of the 
“Standards for Educational and Psychological 
Testing” (the “Standards”), and for the fiscal 
management of the revenue and expenditiue of 
fimds and resomces of that publication. AERA 
was selected to sei've as publisher by the 
Management Committee of the thr ee 

Sponsoring Organizations. As the Executive 
Duector of the AERA. I have administrative 
oversight over all of AERA’ s implementation 
of its responsibilities regarding the Standards 

No Objection. 

4. AERA is a District, of Cohuubia not-for- 
profit corporation. 

No Objection. 
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Public Resource’s Objections 

5. AERA is the major national scientific society 
for research on education and learning. AERA’s 
mission is to advance knowledge about 
education, to encoiuage scholarly mquuy 
related to education, and to promote the use of 
research to improve education and serve the 
public good. 

No Objection. 

6. In 1955, Plaintiffs AERA and NCME 
prepared and published a companion docimient 
to APA’s “Technical Recormuendations for 
Psychological Tests and Diagnostic 

Techniques” (published m 1954), entitled, 
“Technical Recommendations for Achievement 
Tests.” Subsequently, a joint committee of the 
three organizations modified, revised, and 
consolidated the two dociunents mto the first 
Joint Standards. Beginning with the 1966 
revision, the Sponsoring Organizations 
collaborated m developing the “Joint 

Standards” (or simply, the “Standards”). Each 
subsequent revision of the Standards has been 
careful to note that it is a revision and update of 
the prior version. 

ERE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introdrrced 
srrfficient evidence to show the witness has 
personal knowledge of this matter, particrrlarly 
for any time period prior to her employment 
with AERA irr May 2002. 

7. Begiiming in the mid-1950s, the Sponsoring 
Organizatiorrs formed and periodically 
reconstihrted a committee of highly trained and 
experienced experts in psychological and 
edrrcational assessment, charged with the initial 
development of the Technical 

Recommendations and then each srrbseqirent 
revision of the (renamed) Standards. These 
conuuittees were formed by the Sponsorirrg 
Organizations’ Presidents (or then designees), 
who woirld meet and jointly agree orr the 
membership. Often a chan or co-chair s of these 
cormuittees were selected by joint agreement. 
Begirming with the 1966 version of the 

Standards, this committee became referred to as 
the “Joint Cormnittee.” 

ERE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introdrrced 
srrfficient evidence to show the witness has 
personal knowledge of this matter, particrrlarly 
for any time period prior to her employment 
with AERA irr May 2002. 

ERE 701 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfirl to clearly imderstanding the witness’s 
testimony or to determining a fact in issire, 
mclirdmg becaitse the proffered testimony is 
conchrsory; or is based on scierrtific, technical, 
or other specialized knowledge within the 
scope of Ritle 702. 


69 


Case l:14-cv-00857-TSC Document 69-4 Filed 01/21/16 Page 76 of 108 


Declaration of Felice J. Levine In Support of 
Plaintiffs’ Motion for Summary' Judgment 

Defendant-Counterclaimant 

Public Resource’s Objections 

8. Financial and operational oversight for the 
Standards’ revisions, promotion, distribution, 
and for the sale of the 1999 and 2014 Standar ds 
has been imdeitaken by a periodically 
reconstituted Management Committee, 
comprised of the designees of the thr ee 
Sponsoring Organizations. As Publisher of the 
1999 and 2014 Standards, AERA works in 
consultation with the Management Conunittee 
to implement its managerial giridance. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not mtr odirced 
srrffrcient evidence to show the witness has 
personal knowledge of this matter, particrrlar ly 
for any time period prior to her employment 
with AERA in May 2002. 

9. All members of the Joint Committee(s) and 
the Management Corumittee(s) are unpaid 
volimteers. The expenses associated with the 
ongoing development and prrblication of the 
Standards inchtde travel and lodging expenses 
(for the Joint Conmiittee and Management 
Conmiittee members), sirpport staff time, 
production, printing and shipment of boimd 
volitmes, and advertising costs. For the 2014 
Standards, the prodrrction, printing and 
shipment of bormd vohrmes, and advertising 
costs, are paid for by the pitblisher, AERA. 

FRE 403 Prejirdice. The testimony omits any 
relevant timefiame, which confirses the issires, 
and it fails to acknowledge or discrrss the 
expenses that a large niunber of rmpaid 
volimteers and then employers bore in the 
dr afting of the Standards. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introdirced 
sufficient evidence to show the witness has 
personal knowledge of this matter, particularly 
for any time period prior to her employment 
with AERA in May 2002. 

10. Many different fields of endeavor rely on 
assessments. The Sponsoring Organizations 
have ensitred that the range of these fields of 
endeavor is represented m the Joint 

Committee’s membership - e.g., admissions, 
achievement, clinical coimseling, edircational, 
licensing-credentialmg, employment, policy, 
and program evahration. Similarly, the Joint 
Corrmiittee’s members, who are unpaid 
volunteers, represent expertise across major 
fimctional assessment areas - e.g., validity, 
equating, reliability, test development, scoring, 
reporting, interpretation, and large scale 
interpolation. 

FRE 403 Prejudice. The testimony omits any 
relevant timeframe, which confirses the issues. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not intr oduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpflil to clearly imderstanding the witness’s 
testimony or to determuiing a fact in issue, 
rnclirding because the proffered testimony is 
conclusory; or is based on scientific, technical. 
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or other specialized knowledge within the 
scope of Rule 702. 

1 1 . From the time of then initial creation to the 
present, the preparation of and periodic 
revisions to the Standards entail intensive labor 
and considerable cross-disciplmaiy expertise. 
Each time the Standards are revised, the 
Sponsoiing Organizations select and anange for 
extensive meetings of and work by the leading 
authorities in psychological and educational 
assessments (known as the Joint Committee). 
Dining these meetings, certain Standards are 
combined, pared down, and/or augmented, 
others are deleted altogether, and some are 
created as whole new individual Standards. The 
1999 version of the Standards is nearly 200 
pages, took more than five years to complete. 

ERE 403 Prejudice. The testimony omits any 
relevant timefiame, which confiises the issues. 

ERE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

ERE 701 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfiil to clearly imderstanding the witness’s 
testimony or to deteiinining a fact in issue, 
including because the proffered testimony is 
conclusory; or is based on scientific, technical, 
or other specialized knowledge within the 
scope of Rule 702. 

ERE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of a 
document. 

12. The Standards were not created or updated 
to serve as a legally binding document, in 
response to an expressed governmental or 
regulatory need, nor in response to any 
legislative action or judicial decision. However, 
the Standards have been cited in judicial 
decisions related to the proper use and evidence 
for assessment, as well as by state and federal 
legislators. Tliese citations injudicial decisions 
and dining legislative deliberations occimed 
without any lobbying by the Plaintiffs. 

ERE 403 Prejudice. The testimony omits any 
relevant timefiame, which confiises the issues 
as to which editions of the Standards and 
which years the witness is refening to. 

ERE 602 Lack of Personal Knowledge. The 
proffered testuuony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter, particularly 
as to the goals of the many authors of the 
Standards. 

ERE 701 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception and is not 
helpfiil to clearly imderstanding the witness’s 
testimony or to determining a fact in issue. 


71 


Case l:14-cv-00857-TSC Document 69-4 Filed 01/21/16 Page 78 of 108 


Declaration of Felice J. Levine In Support of 
Plaintiffs’ Motion for Summary Judgment 

Defendant-Counterclaimant 

Public Resource’s Objections 


hicluding because the proffered testimony is 
conclusory. 

FRF 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of a 
document. 

13. AERA has not solicited any govermneut 
agency to incoiporate the Standards into the 

Code of Federal Regulations or other rales of 
Federal or State agencies. 

FRF 403 Prejudice. The testimony omits any 
relevant timeframe, which confrises the issues 
as to which editions of the Standards and 
which years the witness is refeixing to. 
Moreover, Plaintiffs refused to provide 
discovery concerning any edition of the 
Standards other than the 1999 Standards, arrd it 
would be unfau ly prejirdicial to allow them to 
introduce testimony on the 2014 Standards or 
other editions at sitmmary jirdgment. 

FRF 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
arrd the proffering party has not mtroduced 
sufficient evidence to show the witness has 
personal knowledge of this matter, particirlar ly 
as to any time period before she was employed 
by AERA in May 2002. 

FRCP 26(a) and 37 Wrthheld Evidence. 

Plaintiffs refiised to provide eviderrce or 
testimony concerning any edition of the 
Starrdards other than the 1999 Edition, and 
redacted docirments that inchtded data 
concenring the 1985 and 2014 editions of the 
Standards. See ICE Ex. 62 
(Plaintiffs/coimterclaim-defendants’ 

Objections and Answers to 
Defendant/cormterclaim-plaintiff s Fust Set of 
Intenogatories (Nos. 1-10) (objecting to 
prodirction of docirments concerning any 
publications other than the 1999 Standards and 
stating that such docmneuts are melevant)); 

ICE Ex. Ex. 63 (coiTespondence PRO coimsel 
identifying ear lier versions and redactions as 
issues in discovery). Plaintiffs should not be 
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allowed to now testify on matters they refrised 
to allow discovery into. 

14. Plaintiffs promote and sell copies of the 
Standards via refeirals to the AERA website, at 
annual meetings, in public offerings to students, 
and to educational institution faculty. 
Advertisements promoting the Standards have 
appeared in meeting brochmes, in scholarly 

ERE 403 Prejudice. The testimony omits any 
relevant timefr ame and does not specify which 
editions of the Standar ds ar e referred to, which 
confuses the issues. Plaintiffs ceased selling 
and promoting the 1999 Standards in 2014, 
and only resirmed selling it in July 2015^^B 

joiunals, and in the hallways at professional 
meetings. Accompanying this Declaration as 
Exhibit NNN is a true copy of advertisements 
promoting the 1999 Standards, marked as 

Exhibit 1218 dining my deposition. 


15. All copies of the Standards bear a copyright 
notice. 

ERE 402 Relevance. The proffered testimony 
does not have any tendency to make a fact of 
consequence more or less probable than it 
would be without the evidence. 

ERE 403 Prejudice. The testimony does not 
specify which editions of the Standards the 
witness is refening to, which confrises the 
issues. Plaintiffs refrised to provide discovery 
concerning any edition of the Standards other 
than the 1999 Standards, and it would be 
imfairly prejudicial to allow them to introduce 
testimony on other editions of the Standards at 
summary judgment. 

ERE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of a 
document. 

16. Distr ibution of the Standards is closely 
monitored by the Sponsoring Organizations. 
AERA, the designated publisher of the 

Standards, sometimes provides promotional 
complementary print copies to stirdents or 
professors. Except for these few complementary 

ERE 403 Prejudice. The testimony omits any 
relevant timefr ame and does not specify which 
editions of the Standards is referred to, wliich 
confrises the issues. Plaintiffs ceased selling 
and promoting the 1999 Standards in 2014, 
and only resumed selling it in recent months 

print copies, however, the Standards are not 
given away for free; and certainly they are not 
made available to the public by any of the thr ee 
organizations for anyone to copy fr ee of charge. 
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To date, AERA has never posted, or authorized 
the posting of, a digitized copy of the 1999 
Standards on any publicly accessible website. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
wihiess’s personal knowledge of the matter 
and the proffering party has not intr oduced 
sufficient evidence to show the witness has 
personal knowledge of this matter, particularly 
as to any time per iod before she was employed 
by AERA in May 2002, and the activities of 
the other Plaintiffs. 

17. The 1999 Standards have been sold at retail 
prices ranging from $25.95 to $49.95 per copy. 
From 2000 to 2014, except for the near two- 
year period dining which Public Resomce 
posted imauthorized copies online and sales 
diminished significantly, income generated 
fr om sales of the 1999 Standards, on average, 
had been approximately in excess of $127,000 
per year. 

FRE 403 Prejudice. The “average” gross 
revenue that the witness describes fails to note 
the fluctuations in sales revenue dining the 
first 12 years that the 1999 Standards were on 
sale, nor the general downward trend of sales 
revenue. Nor does the witness’s testimony 
explain how she arrived at her calculations. 

The probative value of the proffered testimony 
is substantially outweighed by a danger of 
imfan prejudice, conftisiug the issues, and 
misleading the factfinder. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering paify has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opmion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfril to clearly imderstanding the witness’s 
testimony or to deteiiuming a fact in issue, 
including because the proffered testimony is 
conclusory; or is based on scientific, technical, 
or other specialized knowledge within the 
scope of Rule 702. 

FRE 702 Umeliable Expert Opinion. The 
proffered testimony is an expert opinion by a 
witness who is not qualified as an expert by 
knowledge, skill, experience, framing, or 
education. The testimony fiulher will not help 
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the trier of fact to imderstand the evidence or 
to detemiine a fact in issue; is not based on 
sufficient facts or data; is not the product of 
reliable principles and methods; and is not 
based on the expert’s reliable application of 
reliable principles and methods to the facts of 
the case. 

ERE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of a 
document. 

18. Accompanying this Declaration as 

Exhibit OOO is a true copy of AERA’s 

Statement of Revenue and Expenses for the 
Standaids from FY2000 to December 31, 2013, 
marked as Exhibit 1211 during my deposition. 

No Objection. 

19. After the 2014 Standards were published m 
the late smnmer of 2014, AERA for a time 

ERE 403 Prejudice. A^epositioi^AE^A^ 
Rule 30(b)(6) witness 

discontinued sales of the 1999 Standards. This 
was to encom age sales of the newly-revised 
edition - the 2014 Standaids. Accompanying 
this Declaration as Exhibit PPP is a tnie copy of 


the publication page for the 1999 Standards on 
the AERA website as of May 4, 2015 showing 
that the 1999 Standards were not available for 
sale at that time, marked as Exhibit 1196 dining 
my deposition. 

should not now be allowed to introduce 
testimony on this subject, as the probative 
value of the proffered testunony is 
substantially outweighed by a danger of imfair 
prejudice. 

20. However, so long as purchasers are made 
aware that it is no longer the ciment edition, the 
1999 Standards do have an endming value for 
those m the testing and assessment profession 
who (i) need to know the state of best testmg 
practices as they existed between 1999 and 

2014, (ii) believe they still may be held 
accoimtable to the guidance of the 1999 

Standards even now, and/or (iii) study the 
changes in best testing and assessment practices 
over time. For this reason, in the smnmer of 

2015 AERA resumed sales of the 1999 

Standaids. Accompanying this Declaration as 

ERE 403 Prejudice. Exhibit QQQ is dated 
“12/17/2015” and does not show that the 1999 
Standards were available for sale as of the 
summer of 2015, and the testimony is therefore 
misleading. 

ERE 602 Lack of Personal Knowledge. The 
proffered testunony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

ERE 701 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
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Exhibit QQQ is a tnie copy of the publication 
page for the 1999 Standards on the AERA 
website as updated dining the summer of 2015, 
showing that the 1999 Standards are available 
for sale. 

based on the witness’s perception; is not 
helpfril to clearly imderstanding the witness’s 
testimony or to determining a fact in issue, 
inchrdiug becairse the proffered testimony is 
conclirsory; or is based on scientific, technical, 
or other specialized knowledge within the 
scope of Rirle 702. 

ERE 702 Umeliable Expert Opinion. The 
proffered testimony is an expert opinion by a 
witness who is not qiralified as an expert by 
knowledge, skill, experience, training, or 
education. The testimony fruther will not help 
the trier of fact to imderstand the evidence or 
to determine a fact in issire; is not based on 
sufficient facts or data; is not the product of 
reliable principles and methods; and is not 
based on the expert’s reliable application of 
reliable principles and methods to the facts of 
the case. 

ERE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of a 
document. 

21. All revenue from the sale of the 1999 
Standards above expenses is used to cover the 
publishing costs of the Standards and for the 
preparation of subsequent editions of the 
Standards. The Sponsoring Organizations do 
not distribute any proceeds fr om the sales of the 
Standards to the Sponsoring Organizations. 
Rather, the income from these sales is used by 
the Sponsoring Organizations to offset then 
development and production costs and to 
generate fimds for subsequent revisions. This 
allows the Sponsoring Organizations to develop 
up-to-date, high quality Standards that 
otherwise woirld not be developed due to the 
time and effort that goes into producing them. 

ERE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introdirced 
sirffrcient evidence to show the witness has 
personal knowledge of this matter, particirlar ly 
as to any time period before she was employed 
by AERA in May 2002, and the activities of 
the other Plaintiffs. 

ERE 701 Improper Lay Opinion. The proffered 
testimony as to the effects and necessity of 
Plaintiffs’ financing model is a lay opinion that 
is not rationally based on the witness’s 
perception; is not helpfirl to clearly 
imderstanding the witness’s testimony or to 
determining a fact in issue, including because 
the proffered testimony is conclirsory; or is 
based on scientific, teclmical, or other 
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specialized knowledge within the scope of 

Rule 702. 

FRE 702 Umeliable Expert Opinion. The 
proffered testimony is an expert opinion by a 
witness who is not qualified as an expert by 
knowledge, skill, experience, training, or 
education. The testimony frulher will not help 
the trier of fact to imderstand the evidence or 
to deteiinine a fact in issue; is not based on 
sufficient facts or data; is not the product of 
reliable principles and methods; and is not 
based on the expert’s reliable application of 
reliable principles and methods to the facts of 
the case. 

22. Without receiving revenue from the sales of 
the Standards to offset their preparation costs 
and to allow for frnther revisions, it is very 
likely that the Sponsoring Organizations would 
no longer imdertake to periodically update 
them, and it is imknown who else would. 

FRE 403 Prejudice. The 2014 Standards are 
not implicated by this litigation, and Plaintiffs 
vohmtaiily stopped selling the 1999 Standards, 
the only edition at issue. The witness’s 
statement is misleading because it suggests 
that Rrblic Resomce’s actions risk depriving 
Plaintiffs of income fr om the sale of the 2014 
Standards. The witness’s statement is also 
speculative and risks confiising the issues in 
this case. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introdirced 
sirfficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opmion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfirl to clearly imderstanding the witness’s 
testimony or to detemiining a fact in issrre, 
inchrding becairse the proffered testimony is 
conchrsory; or is based on scientific, techrrical, 
or other specialized knowledge within the 
scope of Rirle 702. 

FRE 702 Umeliable Experf Opinion. The 
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proffered testimony is an expert opinion by a 
witness who is not qrralified as an expert by 
knowledge, skill, experience, training, or 
education. The testimony fruther will not help 
the trier of fact to rmderstand the evidence or 
to determine a fact in issue; is not based on 
sufficient facts or data; is not the product of 
reliable principles and methods; and is not 
based on the expert’s reliable application of 
reliable principles and methods to the facts of 
the case. 

23. The Sponsoring Organizations decided on a 
model of self-fimding of revisions of the 
Standards; that is, from the sale of prior editions 
of the Standards. Fimding for the Standards 
revision process from third party somces (e.g., 
goveiTunental agencies, foimdations, other 
associations interested in testing and assessment 
issues, etc.) was rejected because of the 
appearance or potential of conflicts of interest 
and the importance of users of the Standards 
being able to tmst in then scientific integrity. 

FRE 403 Prejudice. The testimony omits any 
relevant timefr ame, which confiises the issues 
as to which editions of the Standards and 
which years the witness is refening to. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introdrrced 
srrfficient evidence to show the witness has 
personal knowledge of this matter, particular ly 
as to any time period before she was employed 
by AERA in May 2002, and the activities of 
the other Plaintiffs. 

FRE 701 Improper Lay Opinion. The proffered 
testimony as to the effects and necessity of 
Plaintiffs’ financing model is a lay opinion that 
is not rationally based on the witness’s 
perception; is not helpfrrl to clearly 
rmderstanding the witness’s testimony or to 
detemiining a fact in issrte, inchrding becartse 
the proffered testimony is conchrsory; or is 
based on scientific, teclmical, or other 
specialized knowledge within the scope of 

Ritle 702. 

FRE 802 Hearsay. The proffered testimony 
relies on an out-of-coiu1 statement that is 
offered to prove the tnrth of the matter 
asserted. 
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24. Due to the relative minor portion of the 
membership of AERA who devote then careers 
to testing and assessment, it is highly imlrkely 
that the members of AERA will vote for a dues 
increase to fimd fiitine Standards revision 
efforts if Public Resource successflilly defends 
this case and is allowed to post the Standards 
online for the public to download or print for 
free. As a result, the Sponsoring Organizations 
would likely abandon then practice of 
periodically updating the Standards. 

ERE 403 Prejudice. The 2014 Standards are 
not implicated by this litigation, and Plaintiffs 
voliuitarily stopped selling the 1999 Standards, 
the only edition at issue. The witness’s 
statement is misleading because it suggests 
that Public Resoiuce’s actions risk depriving 
Plaintiffs of income from the sale of the 2014 
Standards. The witness’s statement is also 
speculative and risks confrising the issues in 
this case. 

ERE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

ERE 701 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfiil to clearly imderstanding the witness’s 
testimony or to determining a fact in issue, 
inclirdirrg because the proffered testimony is 
conchrsory; or is based on scierrtific, technical, 
or other specialized knowledge within the 
scope of Rirle 702. 

ERE 702 Umeliable Expert Opinion. The 
proffered testimony is an expert opinion by a 
witness who is not qiralified as an expert by 
knowledge, skill, experience, training, or 
edircation. The testimony frnther will not help 
the trier of fact to imderstand the evidence or 
to determine a fact m issire; is rrot based on 
sirffrcient facts or data; is not the product of 
reliable principles and methods; and is not 
based on the expert’s reliable application of 
reliable principles and methods to the facts of 
the case. 
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25. The Standards were registered with the 

U.S. Register of Copyr ights mider Registration 
Number TX 5-100-196, having an effective date 
of December 8, 1999. Accompanying this 
Declaration as Exhibit RRR is a hare copy of the 
December 8, 1999 Copyright Certificate of 
Registration for the 1999 Starrdards. 

No Objection. 

26. A supplementary cop 5 Tight registration for 
the Standards was issued by the U.S. Register 
of Copyr ights imder Sirpplementary 

Registration Nimrber TX 6-434-609, havirrg an 
effective date of February 25, 2014. This 
Supplementary Registration was obtained to 
correct an error in the listing of copyr ight 
ownership in Registration Nitmber TX 5-100- 
196. Accompanying this Declaratiorr as 

Exhibit SSS is a true copy of the February 25, 
2014 Supplementary Copyright Certificate of 
Registration for the 1999 Starrdards. 

ERE 602 Lack of Personal Knowledge. The 
proffered testimony is rrot based on the 
witrress’s personal krrowledge of the matter 
arrd the proffering party has not irrhoduced 
sufficient eviderrce to show the witness has 
personal knowledge of this matter. 

ERE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of a 
docirmerrt. 

27. The Joint Corrrmittee that authored the 1999 
Standards comprised 16 members. 

ERE 403 Prejirdice. At depositiorr. Plaintiffs’ 
Rirle 30(b)(6) representative on the subject of 
copyrightownershipandassiarmentsta^ 


Additionally, the witness fails to mention that 
himdreds of irrdividirals, organizations, and 
other entities participated irr the development 
of the 1999 Standards nr collaboration with the 
Joint Committee members. See SME 1 9.,^J 


The 

probative vahre of the proffered testimony is 
substantially outweighed by a danger of irnfah 
prejudice, confirsing the issites, and misleading 
the factfinder. 

ERE 602 Lack of Personal Knowledge. The 
witness was not hired imtil May 2002, years 
after the Joint Courmittee for the 1999 

Starrdards completed its work. The proffered 
testimony is not based on the witness’s 
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personal knowledge of the matter and the 
proffering party has not introduced sufficient 
evidence to show the witness has personal 
knowledge of this matter. 

28. Accompanying this Declaiation as 

Exhibit TTT is a tine copy of the 1999 

Standards. 

No Objection. 

29. Public Resomce posted Plaintiffs’ 1999 
Standards to its website and the hiteraet 

Archive website without the permission or 
authorization of any of the Sponsoring 
Organizations. 

ERE 602 Lack of Personal Knowledge. The 
proffered testunony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter, particularly 
as to the activities of individuals at APA and 
NCME. 

30. The Sponsoring Organizations can only 
speculate on the number of electronic copies of 
the 1999 Standards that were made and 
distiibuted to others by the original Internet 
users who accessed the imauthorized copies that 
Public Resomce posted to its site and the 

Internet Archive site. There simply is no way 
for the Sponsoring Organizations to calculate 
with any degr ee of certainty the number of 
imiversity/college professors, students, testing 
companies and others who would have 
piuchased Plaintiffs’ Standards but for then 
wholesale posting on Defendant’s 
httDs://law.resoiuce.or 2 website and the Internet 
Archive httr)://archive.ora website. 

ERE 403 Prejudice. Plaintiffs have the bmden 
of provmg infringement, and lacking evidence, 
cannot simply invite the Comt to “speculate” 
as to the existence and number of downstream 
copies. The probative value of the proffered 
testimony is substantially outweighed by a 
danger of imfah prejudice, confiising the 
issues, misleading the factfinder, and wasting 
time. 

ERE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering paity has not intioduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

ERE 701 Improper Lay Opmion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfiil to clearly imderstanding the witness’s 
testimony or to detennining a fact in issue, 
including because the proffered testimony is 
conclusory; or is based on scientific, technical, 
or other specialized knowledge witliin the 
scope of Rule 702. 
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ERE 702 Umeliable Expert Opinion. The 
proffered testimony is an expert opinion by a 
witness who is not qualified as an expert by 
knowledge, skill, experience, training, or 
education. The testimony fruther will not help 
the trier of fact to imderstand the evidence or 
to determine a fact in issue; is not based on 
sufficient facts or data; is not the product of 
reliable principles and methods; and is not 
based on the expert’s reliable application of 
reliable principles and methods to the facts of 
the case. 

3 1 . In December 2013, Plaintiff AERA 
requested in writing that Public Resomce 
remove the 1999 Standards from its online 
postings. Accompanying this Declaration as 
Exhibit UUU is a tine copy of a letter sent fr om 
John S. Neikrrk, Director of Publications at 
AERA, to Carl Malaniud of Public Resomce 
regarding the posting of the 1999 Standards at 
httDs://law.resomce.ora/mib/us/cfr/ibr/00 1/aera. 
standards. 1999.t)df marked as Exliibit 1228 
dining my deposition. 

No Objection. 

32. Had Public Resomce not promised to 
remove the 1999 Standards from its 
law.resomce.ors website and the Internet 

Archive website while this lawsuit is pending, 
and followed through with, these promises, the 
Sponsoring Organizations seriously 
contemplated moving forward with a motion to 
preliminary [^/c] enjoin Public Resomce from 
maintaining the imauthoiized postings of 
electronic copies of the 1999 Standards on the 
Internet, and delaying publication of the 2014 
Standards. 

ERE 402 Relevance. Hie proffered testimony 
does not have any tendency to make a fact of 
consequence more or less probable than it 
would be without the evidence. 

33. By Jmie 2014, when Public Resomce finally 
removed its online postings of the 1999 
Standards, the damage aheady had been done. 

In Fiscal Year (“FY”) 201 1 to FY 2012, as 
compared to FY 2011, the Sponsoring 

ERE 403 Prejudice. The probative value of the 
proffered testimony on sales is substantially 
outweighed by a danger of imfair prejudice, 
confiising the issues, and misleading the 
factfinder, because the witness’s conclusions 
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Orgauizations experienced a 34% drop in sales 
of the 1999 Standards. In FY 2013, sales of the 
1999 Standards remamed at then low level from 
the prior fiscal year. 

are both contrary to fact and mischaracterize 
the evidence. What the witness presents as 
sales data is actirally gross revenue data. The 
witness fails to provide context as to the 
general decline hi both sales and revenues for 
the 1999 Standards that began prior to Public 
Resource^spostingofthel999 Standards^^ 


FRE 602 Lack of Personal Knowledge. The 
proffered testunony is not based on the 
witness’s personal knowledge of the matter 
and the proffering parly has not mtroduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Ophiion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfril to clearly imderstauding the witness’s 
testimony or to detenuiuing a fact in issue, 
mcludmg because the proffered testimony is 
conclusory; or is based on scientific, technical, 
or other specialized knowledge withm the 
scope of Rule 702. 

FRE 702 Umeliable Expert Opinion. The 
proffered testimony concemhig the sales of the 
1999 Standards and hami attributed to Public 
Resomce is an expert ophiion by a witness 
who is not qualified as an expert by 
knowledge, skill, experience, training, or 
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education. The testimony frufher will not help 
the trier of fact to imderstand the evidence or 
to determine a fact irr issrre; is rrot based on 
srrfficient facts or data; is not the prodrrct of 
reliable principles and methods; and is not 
based on the expert’s reliable application of 
reliable principles and methods to the facts of 
the case. 

34. This is notable, given that Public Resoiuce 
posted the Standards to the Internet in 2012- 
2013, and that the Sponsoring Organizations’ 
updated Standards were not published imtil the 
summer of 2014. 

FRE 403 Prejitdice. The witness does not 
specify when precisely Pirblic Resorrrce posted 
the 1999 Standards, and invites specirlation as 
to a cormection between Pirblic Resomce’s 
actions and the sales of the 1999 Standards, 
which were in decline prior to the posting of 
the 1999 Standards. The probative vahre of the 
proffered testimony on sales is sirbstantially 
oirtweighed by a danger of imfair prejirdice, 
confrrsing the issires, and misleading the 
factfrnder. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introdirced 
sirfficieut evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfrrl to clearly imderstanding the witness’s 
testimony or to determining a fact in issue, 
including because the proffered testimony is 
conclusory; or is based on scientifrc, technical, 
or other specialized knowledge within the 
scope of Rule 702. 

35. Past hann from Public Resource’s 
infr inging activities includes lost sales that 
cannot be totally accoimted for — due to 
potentially infrnite Internet distribution; for 
example, by psychometrics students — and a 
lack of frmding that otherwise would have been 

FRE 403 Prejirdice. The witness’s statement 
regarding “potentially infinite Interuet 
distribution” has no factiral basis and invites 
speculation thr ough irmealistic and bombastic 
terminology. The probative vahre of the 
proffered testimony is substantially 
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available for the update of the Sponsoring 
Organizations’ Standards from the 1999 to the 
2014 versions. 

oirtweighed by a danger of rmfair prejudice, 
confirsing the issires, and misleading the 
factfinder. 

FRE 602 Lack of Personal Krrowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opmion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfirl to clearly imderstanding the witness’s 
testimony or to detemiming a fact in issire, 
irrchrdirrg becairse the proffered testimony is 
conchrsory; or is based on scientific, technical, 
or other specialized knowledge within the 
scope of Ritle 702. 

FRE 702 Umeliable Expert Opinion. The 
proffered testimony concemrng harm 
attributed to Pirblic Resomce is an expert 
opinion by a witness who is not qiralified as an 
expert by knowledge, skill, experience, 
training, or edircation. The testimony fiuther 
will not help the frier of fact to imderstarrd the 
evidence or to determine a fact in issire; is not 
based on sirfficient facts or data; is not the 
product of reliable principles and methods; and 
is not based on the expert’s reliable application 
of reliable principles and methods to the facts 
of the case. 

36. Should Public Resomce’s infringement be 
allowed to continue, the harm to the Sponsoring 
Organizations, and public at large who rely on 
the preparation and administr ation of valid, fan 
and reliable tests, inchrdes: (i) imcontrolled 
publication of the 1999 Standards withoirt any 
notice that those giridelines have been replaced 
by the 2014 Standards; (ii) firtine imqirantifrable 
loss of revenire from sales of airthorized copies 

FRE 403 Prejitdice. The 2014 Standards are 
not at issue in this litigation, and Plaintiffs 
vohmtarily stopped selling the 1999 Standards, 
the only edition at issire. The witness’s 
statement is misleading because it suggests 
that Public Resoiuce’s actions risk depriving 
Plaintiffs of income fiom the sale of the 2014 
Standards. The witness’s statement is also 
speculative and risks confirsing the issues in 
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of the 1999 Standards (with proper notice that 
they are no longer the ciment version) and the 
2014 Standards; and (iii) lack of fiinding for 
fiitme revisions of the 2014 Standards and 
beyond. 

this case. 

FRE 602 Lack of Personal Knowledge. The 
proffered testunony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not intioduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opuiion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfiil to clearly understanding the witness’s 
testimony or to deteiinining a fact in issue, 
includmg because the proffered testimony is 
conclusoiy; or is based on scientific, technical, 
or other specialized knowledge within the 
scope of Rule 702. 

FRE 702 Umeliable Expert Opinion. The 
proffered testunony corrcenrmg harm 
attributed to Public Resoiuce is an expert 
opinion by a witness who is not qiralified as an 
expert by knowledge, skill, experience, 
training, or education. The testimony ftuther 
will not help the trier of fact to imderstarrd the 
evidence or to determine a fact in issue; is not 
based on sufficierrt facts or data; is not the 
product of reliable principles and methods; and 
is not based on the expert’s reliable application 
of reliable prirrciples and methods to the facts 
of the case. 


VII. OBJECTIONS TO THE DECLARATION OF DIANN'E L. SCHNEIDER IN 
SUPPORT OF PLAINTIFFS’ MOTION FOR SUMMARY JUDGMENT AND 
ENTRY OF A PERVIANENT INJUNCTION 


Declaration of Dianne L. Schneider 

Defendant-Counterclaimant 

In Support of Plaintiffs’ Motion for 
Summary Judgment 

Public Resource’s Objections 

1. 1 am a Senior Hrtman Capital Consultant at 
Persormel Decisions Research hrstitirte 

No Objection. 
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(“PDRI”). My work for PDRI includes 
providing consulting services, in areas such as 
performance management and career 
development, to a variety of public and private 
sector clients. I submit this Declaration in 
support of the motion of the American 
Educational Research Association, Inc. 
(“AERA”), the American Psychological 
Association, Inc. (“APA”), and the National 
Coimcil on Measurement in Education, Inc. 
(“NCME”) (collectively, “Plaintiffs” or 
“Sponsoring Organizations”) for simunaiy 
judgment and the entry of a permanent 
injimction. 


2. Prior to working at PDRI, from 1998 throirgh 
2012, 1 worked as a private consirltant, 
providing consulting services for the APA and 
for Valtera, Inc. in the areas of leader, 
assessment and development, and psychological 
testing and assessment. Betweerr 2009 and 

2012, 1 worked as a consirltant and a project 
coordinator for APA dining the revision by the 
Joint Committee of the Sponsoring 

Organizations of the 1999 edition of the 
Standards for Educational and Psychological 
Testing (the “Standards”) that were published in 
2014. Prior to becoming a private consultant, 
from 1994 through 1998, 1 worked as a Testing 
and Assessment Officer at the APA. Prior to 
becoming a Testing and Assessment Officer, 
from 1992 to 1994, 1 worked as a Research 
Officer for APA. From 1993 through 1998, 1 
also participated as a staff liaison for the Joint 
Committee dming then revision of the 1985 
edition of the Standards that were produced in 
published in 1999. 

No Objection. 

3. My work for the revision of the 1985 

Standards published in 1999, and my work for 
the revision of the 1999 Standar ds published in 
2014, consisted of providing administrative 

No Objection. 
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Defendant-Counterclaimant 

In Support of Plaintiffs’ Motion for 
Summary Judgment 

support to the project, such as aixanging 
meetmg logistics, taking notes and preparing 
minutes from the meetings, and managing 
cormuittee conespondence including sending 
dr aft versions of the Standards for comment and 
compilmg input fr om the public reviews. 

Public Resource’s Objections 

4. Financial and operational oversight for the 
Standards’ revisions, promotion, distribution, 
and for the sale of the 1999 and 2014 Standards 
has been imdertaken by a periodically 
reconstituted Management Committee, 
comprised of the designees of the thr ee 
Sponsoring Organizations. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introdirced 
sirfficient evidence to show the witness has 
personal knowledge of this matter. 

5. All members of the Joint Conuuittee(s) and 
the Management Committee(s) are unpaid 
vohmteers. The expenses associated with the 
ongoing development and pirblication of the 
Standards mchtde travel and lodging expenses 
(for the Joint Conmiittee and Management 
Conmiittee members), sirpport staff time, 
printing and shipment of bormd vohunes, and 
advertising costs. 

FRE 403 Prejirdice. The testimony omits any 
relevant tunefiame, which confirses the issires, 
and it fails to acknowledge or discirss the 
expenses that a large nirmber of impaid 
vohmteers and then employers bore in the 
dr afting of the Standar ds. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not irrtroduced 
sirfficient evidence to show the witness has 
personal knowledge of this matter. 

6. Draft revisions of the 1985 Standards, for 
what became the 1999 Standards, were widely 
distribirted for pirblic review and comment three 
times dirring this revision effort to gaitge 
whether the testing cormmmity believed the 
revised dr afts to be ciment and inchrsive of the 
topics at issite. 

No Objection. 

7. The Joint Committee received thousands of 
pages of comments and proposed text revisions 
fr om: the membership of the Sponsoring 
Organizations, scientific, professional, trade and 
advocacy groirps, credentialing boards, state 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony as to the Joint 

Committee’s use of submitted comments and 
language is not based on the witness’s personal 
knowledge of the matter and the proffering 
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Defendant-Counterclaimant 

In Support of Plaintiffs’ Motion for 
Summary Judgment 

Public Resource’s Objections 

and federal goveminent agencies, test 
publishers and developers, and academic 
institutions. While the Joint Committee 

party has not introduced sufficient evidence to 
show the witness has personal knowledge of 
this matter. 

reviewed and took imder advisement these 
helpful comments, the final language of the 

1999 Standards was a product of the Jomt 
Committee members. 

FRE 701 Improper Lay Opuiion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfiil to clearly imderstanding the witness’s 
testimony or to determining a fact in issue, 
including because the proffered testimony is 
conclusory; or is based on scientific, technical, 
or other specialized knowledge within the 
scope of Rule 702. 


VIII. OBJECTIONS TO THE DECLARATION OF LAURESS L. WISE IN SUPPORT 
OF PLAINTIFFS MOTION FOR SUMMARY JLDGMENT AND ENTRY OF A 
PERMANENT INJUNCTION 


Declaration of Lauress L. Wise In Support of 
Plaintiffs’ Motion for Summary Judgment 

Defendant-Counterclaimant 

Public Resource’s Objections 

1 . 1 am the Inunediate Past President of the 
National Coimcil on Measiuement in 

Education, Inc. (“NCME”). I have been a 
member of this organization for approximately 

30 years. I previously was the President of 
NCME fiom April 2014 through April 2015, 
and Vice President of this organization from 
April 2013 through April 2014. 1 sirbmit this 
Declaration in sirpport of the motion of the 
American Edircational Research Association, 

Inc. (“AERA”), the American Psychological 
Association, Inc. (“APA”), and the NCME 
(collectively, “Plaintiffs” or “Sponsoring 
Organizations”) for sirmrnary jirdgment and the 
entry of a permanent injimction. 

No Objection. 

2. 1 also am a principal scientist with the 

Hirman Resoiuces Research Organization 
(“HimiRRO”), spending frrll time on research 

No Objection. 
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and evaluation projects relating to educational 
measiuenient. I previously sei'ved as HmuRRO 
CEO for 13 years, combining management and 
research activities and, before that, duected 
research and development for the Aimed 

Services Vocational Aptitude Battery for the 
Department of Defense. Before that I spent 

16 years as a researcher for the American 
Institutes for Research, rising to the position of 
Du ector of Research. I am also a member of 
both AERA and APA. 


3. NCME is a Distr ict of Columbia not-for- 
profit corporation. 

No Objection. 

4. NCME is a professional organization for 
individuals involved in assessment, evaluation, 
testing, and other aspects of educational 
measiuement. NCME’s members are involved 
in the conshuction and use of standardized 
tests; new forms of assessment, including 
peifoimance-based assessment; program 
design; and progr am evaluation. 

No Objection. 

5. In 1955, AERA and NCME prepared and 
published a companion document to APA’s 
“Technical Recommendations for Psychological 
Tests and Diagnostic Techniques” (published in 
1954), entitled “Technical Recommendations 
for Achievement Tests.” 

ERE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not mtroduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

6. Subsequently, a jomt committee of the tliree 
organizations modified, revised and 
consolidated the two documents into the first 
Joint Standards. Beginning with the 1966 
revision, the Sponsoring Organizations 
collaborated in developing the “Joint 

Standards” (or simply, the “Standards”). Each 
subseqirent revision of the Standards has been 
carefirl to note that it is a revision and update of 
that document 


7. Begirming in the mid-1950s, the Sporrsoring 

ERE 602 Lack of Personal Knowledge. The 
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Organizations foraied and periodically 
reconstituted a coininittee of experts in 
psychological and educational assessment, 
charged with the initial development of the 
Technical Recommendations and then each 
subsequent revision of the (renamed) Standards. 
These committees were formed by the three 
organizations’ Presidents (or then designees), 
who wortld meet and jointly agree on the 
membership. Ofterr a chan or co-chairs of these 
cormuittees were selected by joint agreement. 
Begirming with the 1966 version of the 

Standards, tliis committee became referred to as 
the “Joint Couunittee.” For example, I was the 
co-chair of the Joint Coumiittee for the 2014 
edition of the Standards. 

proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not mtrodirced 
sirfficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opmion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpflrl to clearly imderstanding the witness’s 
testimony or to detemiining a fact in issrre, 
inchrdmg becairse the proffered testimony is 
conchrsory; or is based on scientific, technical, 
or other specialized knowledge witliur the 
scope of Rirle 702. 

8. Financial and operational oversight for the 
Standards’ revisions, promotion, distribirtiou. 
and for the sale of the 1999 arrd 2014 Standards 
has been imdertaken by a periodically 
reconstitirted Management Committee, 
comprised of designees of the thr ee Sponsoring 
Organizations. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witrress’s personal krrowledge of the matter 
and the proffering party has not irrtrodirced 
sirfficient evidence to show the witness has 
personal knowledge of this matter. 

9. All members of the Joint Courmittee(s) and 
the Marragement Couuuittee(s) are impaid 
vohmteers. The expenses associated with the 
ongoing development and pirblicatiorr of the 
Standards inchtde travel and lodging expenses 
(for the Joint Conmiittee and Management 
Committee members), support staff time, 
printing and shipment of boimd vohunes, and 
advertising costs. 

FRE 403 Prejudice. The testimony omits any 
relevant timefiame, which confirses the issires, 
and it fails to acknowledge or discuss the 
expenses that a lar ge uiuuber of impaid 
vohmteers and then employers bore in the 
drafting of the Standar ds. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

10. Many different fields of endeavor rely on 
assessments. The Sponsoring Organizations 
have eusiued that the range of these fields of 
endeavor is represented in the Joint 

FRE 403 Prejudice. The testimony omits any 
relevant timefiame, which confirses the issues. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
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Committee’s membership - e.g., admissions, 
achievement, clinical coimseling, educational, 
liceusing-credentialmg, employment, policy, 
and program evaluation. Similarly, the Joint 
Committee’s members represent expertise 
across major fimctional assessment areas - 
e.g., validity, eqirating, reliability, test 
development, scoring, reporting, interpretation, 
large scale interpolation and cognitive 
behavioral therapy. 

witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfirl to clearly imderstanding the witness’s 
testimony or to determining a fact in issue, 
including becairse the proffered testimony is 
conclusory; or is based on scientific, technical, 
or other specialized knowledge within the 
scope of Rule 702. 

1 1 . From the time of then initial creation to the 
present, the preparation and periodic revisions 
to the Standards entail intensive labor and 
considerable cross-disciplinary expertise. Each 
time the Standards are revised, the Sponsoring 
Organizations select and arrange for meetmgs 
of the leading airthorities in psychological and 
edircational assessments (known as the Joint 
Coumiittee). Diuing these meetmgs, certain 
Standards are combined, pared down, and/or 
airgmeuted, others are deleted altogether, and 
some are created as whole new individiral 
Standards. The 1999 version of the Standards is 
nearly 200 pages, and took more than five year s 
to complete - resulting from work pirt in by the 
Joint Committee to generate a set of best 
practices on edircational and psychological 
testing that are respected and relied upon by 
leaders in then fields. 

FRE 403 Prejudice. The testimony omits any 
relevant timefiame, which confiises the issues. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering paity has not intioduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opmion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfiil to clearly imderstanding the witness’s 
testimony or to deteiniining a fact in issue, 
including because the proffered testimony is 
conclusoiy; or is based on scientific, technical, 
or other specialized knowledge witliin the 
scope of Rule 702. 

FRE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of a 
document. 

12. The Standards originally were created as 
principles and giridelines - a set of best 
practices to improve professional practice in 
testing and assessment across multiple settings, 
including education and varioirs areas of 
psychology. The Standards can and should be 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 
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used as a recommended comse of action in the 
soimd and ethical development and use of tests, 
and also to evaluate the quality of tests and 
testing practices. Additionally, an essential 
component of responsible professional practice 
is maintaining technical competence. Many 
professional associations also have developed 
standards and principles of technical practice in 
assessment. Hie Sponsoring Organizations’ 
Standards have been and still are used for this 
piupose. 

ERE 701 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpM to clearly imderstanding the witness’s 
testimony or to deteimining a fact in issue, 
including because the proffered testimony is 
conclusory; and is based on scientific, 
technical, or other specialized knowledge 
within the scope of Rule 702. 

13. The Standards, however, are not simply 
intended for members of the Sponsoring 
Organizations, AERA, APA, and NCME. The 
intended audience of the Standards is broad and 
cuts across audiences with varying backgioimds 
and different tiaining. For example, the 

Standards also are intended to guide test 
developers, sponsors, publishers, and users by 
providing criteria for the evaluation of tests, 
testing practices, and the effects of test use. Test 
user standards refer to those standards that help 
test users decide how to choose certain tests, 
inteipret scores, or make decisions based on 
tests results. Test users include clinical or 
industrial psychologists, research directors, 
school psychologists, coimselors, employment 
supeiwisors, teachers, and various 
administrators who select or inteipret tests for 
then organizations. There is no mechanism, 
however, to enforce compliance with the 
Standards on the part of the test developer or 
test user. The Standards, moreover, do not 
attempt to provide psychometric answers to 
policy or legal questions. 

ERE 403 Prejudice. The testimony omits any 
relevant timefiame, which conflises the issues. 

ERE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering paify has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter, particularly 
for any time period prior to her employment 
with APA, or for the goals or intent of the 
Standards, wliich she did not author. 

ERE 701 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpM to clearly imderstanding the witness’s 
testimony or to deteiniining a fact in issue, 
including because the proffered testimony is 
conclusory; or is based on scientific, technical, 
or other specialized knowledge within the 
scope of Rule 702. 

ERE 702 Umeliable Expert Opinion. The 
proffered testimony on the goals, intent, and 
operation of the Standards is an expert opinion 
by a witness who is not qualified as an expert 
by knowledge, skill, experience, training, or 
education. The testimony fiuther will not help 
the trier of fact to imderstand the evidence or 
to determine a fact in issue; is not based on 
sufficient facts or data; is not the product of 
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reliable piinciples and methods; and is not 
based on the expert’s reliable application of 
reliable principles and methods to the facts of 
the case. 

FRE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of a 
docirmerrt. 

14. The Standards promote the development of 
high quality tests and the soimd use of results 
from such tests. Without such high quality 
standards, tests might produce scores that are 
not defensible or acciuate, not an adequate 
reflection of the characteristic they were 
intended to measme, and not fan to the person 
tested. Consequently, decisions about 
individuals made with such test scores would be 
no better, or even worse, than those made with 
no test score infonnation at all. Thus, the 
Standards help to ensine that measines of 
student achievement are relevant, that 
admissions decisions are fair, that employment 
hir ing and professional credentialing result in 
qualified individuals being selected, and 
patients with psychological needs are diagnosed 
properly and treated accordingly. Quality tests 
protect the public from haiinfiil decision 
making and provide oppoifunities for education 
and employment that are fan to all who seek 
them. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introdirced 
sirfficient eviderrce to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opirrion. The proffered 
testimony is a lay opinion that is not rationally 
based orr the witness’s perception; is not 
helpfirl to clearly rmderstanding the witness’s 
testimony or to determining a fact in issue, 
mchrding becairse the proffered testimony is 
conchrsory; or is based on scientific, technical, 
or other specialized knowledge witlrin the 
scope of Rirle 702. 

15. The Standards apply broadly to a wide 
range of standardized instnunents and 
procedines that sample an individual’s 
behavior, including tests, assessments, 
inventories, scales, and other testing vehicles. 

The Standards apply equally to standardized 
multiple-choice tests, peifoimance assessments 
(including tests comprised of only open-ended 
essays), and hands-on assessments or 
simulations. The main exceptions are that the 
Standards do not apply to imstandardized 

FRE 402 Relevarrce. Tire proffered testimony 
concerning the types of testing the starrdards 
apply to does not have any tendency to make a 
fact of conseqirence in this litigation more or 
less probable than it worrld be withorrt the 
evidence. 

FRE 403 Prejirdice. The testimony omits any 
relevant timeframe and does not specify which 
editions of the Standards are referred to, which 
confirses the issires. 
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questiomiaiies (e.g., imstructiued behavioral 
checklists or obsei-vational forms), teacher- 
made tests, and subjective decision processes 
(e.g., a teacher’s evaluation of students’ 
classroom paificipation over the comse of a 
semester). 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witrress’s personal krrowledge of the matter 
and the proffering party has not intr odirced 
srrfficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opmion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfirl to clearly imderstanding the witness’s 
testimony or to determining a fact in issire, 
inchrdmg becaitse the proffered testimony is 
conchrsory; and is based on scientific, 
technical, or other specialized knowledge 
witlrin the scope of Rirle 702. 

FRE 702 Umeliable Expert Opinion. The 
proffered testimony on the application of the 
Standards is an expert opinion by a witness 
who is not qiralified as an expert by 
krrowledge, skill, experience, training, or 
edircation. The testimony fiuther will not help 
the trier of fact to rmderstand the eviderrce or 
to determirre a fact irr issire; is not based on 
sufficient facts or data; is not the product of 
reliable principles and methods; and is not 
based on the expert’s reliable application of 
reliable principles and methods to the facts of 
the case. 

16. The Standards have been used to develop 
testing guidelines for such activities as college 
admissions, persoimel selection, test 
translations, test user qualifications, and 
computer-based testing. The Standards also 
have been widely cited to address technical, 
professional, and operational norms for all 
forms of assessments that are professionally 
developed and rrsed in a variety of settings. The 
Standards additionally provide a valuable public 
ser’vice to state and federal govermirents as they 
voluntarily choose to rrse them. For instance, 
each testing company, when srrbmitting 

FRE 402 Relevance. Tire proffered testimony 
concerning the use of the Standar ds does not 
have any tendency to make a fact of 
consequence in this litigation more or less 
probable than it would be without the 
evidence. 

FRE 403 Prejudice. The testimony omits any 
relevant timefiame, which confiises the issues. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
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proposals for testing administration, instead of 
relying on a patchwork of local, or even 
individual and proprietary, testing design and 
implementation criteria, may rely instead on the 
Sponsoring Organizations’ Standards to afford 
the best gitidance for testing and assessment 
practices. 

sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opmion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfiil to clearly imderstanding the witness’s 
testimony or to determining a fact in issue, 
including because the proffered testimony is 
conclusory; or is based on scientific, technical, 
or other specialized knowledge withui the 
scope of Rule 702. 

FRE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of 
documents. 

17. The Standards were not created or irpdated 
to serve as a legally binding docirment, in 
response to an expressed governmental or 
regulatory ueed, nor in response to any 
legislative action or jitdicial decision. However, 
the Standards have been cited in jirdicial 
decisions related to the proper use and evidence 
for assessment, as well as by state and federal 
legislators. These citations iu jirdicial decisions 
and dining legislative deliberations occimed 
without any lobbymg by the Plaintiffs. 

FRE 403 Prejudice. The testimony omits any 
relevant tuuefiame, which confirses the issues 
as to which editions of the Standards and 
which years the witness is refening to. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter, particular ly 
as to the goals of the many authors of the 
Standards. 

FRE 701 Improper Lay Opmion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception and is not 
helpfirl to clearly imderstanding the witness’s 
testimony or to determining a fact in issue, 
including because the proffered testimony is 
conclusory. 

FRE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of a 
document. 
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18. NCME has never communicated with 
Congress for the pmpose of encouraging the 
enactment of the Standar ds into law. 

FRF 403 Prejudice. The probative value of the 
proffered testimony is substantially 
oirtweighed by a danger of imfair prejitdice, 
corrfirsing the issites, and misleading the 
factfinder, becairse it omits mention of 

NCME’s participation in a briefing on the 
Standards at Capitol Hill. See, e.g. ICE 

Exs. and 47^9. 

19. Additiorrally, NCME has never solicited any 
government agency to incorporate the Standards 
into the Code of Federal Regirlations or other 
rules of Federal or State agencies. 

FRF 403 Prejitdice. The testimony omits any 
relevant timefiame, which confuses the issues 
as to which editions of the Standards and 
which years the witness is referring to. 
Moreover, Plaintiffs refused to provide 
discovery concerning any edition of the 
Standards other than the 1999 Standards, and it 
would be imfairly prejudicial to allow them to 
introduce testimony on the 2014 Standards or 
other editions at summary judgment. 

FRF 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRCP 26(a) and 37 Withheld Evidence. 
Plaintiffs refused to provide evidence or 
testimony concerning any edition of the 
Standards other than the 1999 Edition, and 
redacted documents that inchrded data 
concerning the 1985 and 2014 editions of the 
Standards. See ICE Ex. 62 
(Plaintiffs/coimterclaim-defendants’ 

Objections and Answers to 
Defendant/coimterclaim-plaintiff s First Set of 
Intenogatories (Nos. 1-10) (objecting to 
production of docirments concemiug any 
publications other than the 1999 Standards and 
stating that such docirments are irielevant)); 

ICE Ex. Ex. 63 (correspondence PRO counsel 
identifying earlier versions and redactions as 
issues in discovery). Plaintiffs should not be 
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allowed to now testify on matters they refrrsed 
to allow discovery into. 

20. In the policymaking arena, NCME believes 
the Standards should be treated as guidelines 
iufonuing the enactment of legislation and 
regulations consistent with best practices in the 
development and use of tests - to insiue that 
they are valid, reliable and fau. 

ERE 403 Prejudice. The testimony omits any 
relevant timeframe, which confrises the issues. 

2 1 . The Sponsoring Organizations promote and 
sell copies of the Standards via referrals to the 
AERA website, at annual meetmgs, in public 
offermgs to students, and to educational 
institution faculty. Advertisements promoting 
the Standards have appeared in meeting 

ERE 403 Prejudice. The testimony omits any 
relevant timefr ame and does not specify which 
editions of the Standar ds are referred to, which 
confuses the issues. Plaintiffs ceased selling 
and promoting the 1999 Standards in 2014, 
and only resitmed selling it in July 2015^^B 

brochiues, m scholarly journals, and in the 
hallways at professional meetmgs. 

Accompanying tliis Declaration as 

Exhibit KKK is a hue copy of advertisements 
for the 1999 Standards published in NCME’s 
Joimial of Educational Management. These 
advertisements were produced at Bates 

Nos. AERA_ APA_NCME_003 1 444-003 1451. 


22. Dishibution of the Standards is closely 
monitored by the Sponsoring Organizations. 
AERA, the designated publisher of the 

Standards, sometimes does provide promotional 
complemeutaiy print copies to shidents or 
professors. Except for these few complementaiy 

ERE 403 Prejitdice. The testimony omits any 
relevant timeframe and does not specify which 
editions of the Standards is referred to, which 
confrrses the issires. Plaintiffs ceased selling 
and promoting the 1999 Standards in 2014, 

print copies, however, the Standards are not 
given away for free; and certainly they are not 
made available to the public by any of the thr ee 
organizations for anyone to copy fr ee of charge. 

ERE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not irrtrodirced 
sirfficient eviderrce to show the witness has 
personal knowledge of this matter, particirlariy 
as to the activities of the other Plaintiffs. 
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23. To date, NCME has never posted, or 
authorized the posting of, a digitized copy of 
the 1999 Standards on any publicly accessible 
website. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

24. Without receiving at least some moderate 
income from the sales of the Standards to offset 
then production costs and to allow for fiuther 
revisions, it is very likely that the Sponsoring 
Organizations would no longer imdeitake to 
periodically update them, and it is unknown 
who else would. 

FRE 403 Prejudice. The 2014 Standards are 
not implicated by this litigation, and Plaintiffs 
vohuitarily stopped selling the 1999 Standards, 
the only edition at issue. The witness’s 
statement is misleading because it suggests 
without justification or basis that Public 
Resoiu'ce’s actions risk depriving Plaintiffs of 
income fr om the sale of the 2014 Standards. 

Tire witness’s statement is also speculative and 
risks confiising the issues in this case. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opinion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfril to clearly imderstanding the witness’s 
testimony or to determining a fact in issue, 
including because the proffered testimony is 
conclusory; or is based on scientific, technical, 
or other specialized knowledge within the 
scope of Rule 702. 

FRE 702 Umeliable Expert Opinion. The 
proffered testimony is an expert opinion by a 
witness who is not qualified as an expert by 
knowledge, skill, experience, training, or 
education. The testimony fiuther will not help 
the trier of fact to imderstand the evidence or 
to determine a fact in issue; is not based on 
sufficient facts or data; is not the product of 
reliable principles and methods; and is not 
based on the expert’s reliable application of 
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reliable principles and methods to the facts of 
the case. 

25. In late 2013 and early 2014, the Sponsoring 
Organizations became aware that the 1999 
Standards had been posted on the Internet 
without then' authorization, and that students 
were obtaining free copies from the posting 
somce. Upon fruther investigation, the 
Sponsoring Organizations discovered that 

Public Resoiuce was the sour ce of the online 
posting. 

FRE 602 Lack of Personal Knowledge. The 
proffering pariy has not introdirced sirfficient 
evidence to show the witness has personal 
knowledge of this matter. 

FRE 701 Improper Lay Opmion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfirl to clearly understanding the witness’s 
testimony or to detennining a fact in issue, 
iuchrdmg because the proffered testimony is 
conchrsory. 

FRE 802 Hearsay. This testimony refers to an 
oirt-of-coiui statement that is offered to prove 
the tnrth of the matter asserted. 

26. Pitblic Resoiuce posted Plaintiffs’ 1999 
Standards to its website and the luteruet 

Archive website without the pertnission or 
airthorization of any of the Sponsoring 
Organizations. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introdirced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

27. Plaintiffs have been made aware that at least 
some of those irsers who obtained the 1999 
Standards for free from Pirblic Resoirrce did so 
to avoid paying the modest sale price for 
airthorized print copies. 

FRE 602 Lack of Personal Knowledge. The 
proffered testimony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not intr oduced 
sufficient evidence to show the witness has 
personal knowledge of this matter. 

FRE 701 Improper Lay Opuiion. The proffered 
testimony is a lay opinion that is not rationally 
based on the witness’s perception; is not 
helpfirl to clearly imderstanding the witness’s 
testimony or to detennining a fact in issue, 
mchrdmg because the proffered testimony is 
conchrsory. 

FRE 802 Hearsay. The proffered testimony is 
an out-of-comt statement that is offered to 
prove the truth of the matter asserted. 
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28. Accompanying this Declaration as 

Exhibit ELL is a true copy of an e-mail dated 
March 5, 2014 from Gregory J. Cizek to me 
regarding a shrdent not pmchasing the 1999 
Standards becairse “they [were] available for 
free online” at 

httDs://law.resoruce.ors/mrbtirs/cfr/ibr/001/aera. 

standards.l999.pdf” This e-mail exchange was 
marked as Exhibit 1252 diuing my deposition. 

ERE 403 Prejitdice. The proffered exhibit is so 
heavily redacted that it is not possible to 
discern the frrll context of the email - only one 
sentence appears and even that sentence is 
partially redacted. The probative vahre of the 
proffered testimony is sirbstantially 
oirtweighed by a danger of rmfair prejirdice or 
misleading the factfinder. 

ERE 602 Lack of Personal Knowledge. The 
proffered testunony is not based on the 
witness’s personal knowledge of the matter 
and the proffering party has not introdrrced 
srrfficient evidence to show the witness has 
personal knowledge of this matter. 

ERE 802 Hearsay. The proffered exhibit is an 
out-of-comt statement that is offered to prove 
the tnrth of the matter asserted. The alleged 
statement by the stirdent that is referred to in 
the email is hearsay-within-hearsay. 

ERE 1002 Secondary Evidence. The proffered 
testimony is offered to prove the contents of a 
docirment. 

FRCP 26(a) and 37 Withheld Evidence. 
Plamtiffs heavily redacted the proffered exhibit 
srrch that its content and context carmot 
properly be imderstood, and shoitld not be 
allowed to now itse it at srrmmary judgment to 
srrggest mferences based off what little content 
can be read. 


CONCLUSION 

Defendant-Couuterclaimant Public. Resomce.Org, Inc. respectflilly requests that this 
Coiut sustam these evidentiary objections at the hearmg on Plamtiffs’ Motion for Siunniaiy 
Judgment and for Entry of a Permanent Injimction. 
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